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ABSTRACT 

The  following  distributed  detection  problem  is  formulated.  We  consider  a  team  that 
comprises  of  two  decision  makers,  who  are  referred  to  as  Decision  Maker  A  (DMA)  and 
Decision  Maker  B  (DMB).  Both  decision  makers  receive  uncertain  measurements  or 
observations,  and  the  goal  of  the  team  is  to  make  a  decision  with  the  objective  of  trying  to 
minimize  the  probability  of  making  an  incorrect  decision.  DMA  processes  his  measurement 
first  and  communicates  to  DMB  one  of  K  messages,  Mlt  M2,  ....  MK.  Based  on  this 
message  and  his  own  observation,  DMB  makes  the  final  decision  of  the  team. 

The  goal  is  to  analyze  the  performance  of  the  above  scheme  (using  values  of  K  greater 
than  two)  and  compare  it  with  the  well  known  case  where  only  two  messages,  Mt  and  M2, 
are  used  by  DMA.  It  is  interesting  to  see  how  the  performance  of  the  team  approaches  that 
of  the  centralized  version  of  the  problem  (i.e,,  two  independent  observations  available  to  a 
single  decision  maker)  with  increasing  values  of  K.  Furthermore,  results  for  the  General  K 
case  have  been  presented  and  can  be  used  to  evaluate  the  performance  of  a  team  where  K 
messages  (K  taking  on  any  value)  are  used  for  communication  between  DMA  and  DMB. 
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Chapter  1 

INTRODUCTION 


This  thesis  addresses  the  design  and  performance  evaluation  of  a  special  class  of  team 
decision  problems,  where  each  member  of  a  team  of  decision  makers  receives  conditionally 
independent  observations  about  some  underlying  binary  hypothesis.  The  objective  of  the 
team  is  to  make  an  optimal  decision.  We  study  the  effects  of  increasing  the  communication 
between  the  team  members. 

U  EiahlaalkfinitiflQ 

The  problem  can  be  formulated  as  one  of  target  detection.  The  decision  team  consists 
of  two  decision  makers,  namely  Decision  Maker  A  (DMA)  and  Decision  Maker  B  (DMB). 
Each  decision  maker  receives  conditionally  independent  observations  and  the  goal  of  the 
team  is  to  make  an  optimal  decision  to  choose  between  two  hypotheses,  Hq  and  In  a 
target  detection  context,  H0  may  mean  no  target,  while  Hj  denotes  the  presence  of  a  target. 

The  operation  of  the  team  is  described  as  follows.  DMA  processes  the  measurement 
from  his  sensor  and  arrives  at  a  decision.  This  preliminary  decision,  which  can  be  one  of 
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K  messages,  M1(  M2,  MK  (K  =  2,  3,  ...),  is  passed  on  to  DMB.  Using  his  own 
measurement  and  the  message  from  DMA,  DMB  arrives  at  the  final  decision  of  the  team. 
In  other  words,  DMB  has  the  final  responsibility  for  declaring  the  presence  or  absence  of  a 
target. 

The  objective  of  the  team  is  to  make  an  optimal  decision,  i.e.,  one  that  minimizes  both 
the  probability  of  missed  detection  and  the  probability  of  false  alarm.  In  this  context,  as  the 
number  (K)  of  messages  increases,  we  are  providing  DMB  with  more  accurate  information 
about  DMA's  observation.  We  study  the  implications  of  this  on  the  probabilities  of  missed 
detection  and  false  alarm  of  the  final  team  decision. 

The  theme  of  this  research  is  to  evaluate  the  performance  of  the  K-message  (using 
values  of  K  greater  than  two)  Distributed  Detection  Network  shown  in  Figure  lb,  and 
compare  it  with  that  of  the  two-message  (K  =  2)  Distributed  Detection  Network  shown  in 
Figure  la.  In  order  to  accomplish  this,  the  linear  Gaussian  case  is  considered  (i.e.,  where 
the  observations  are  linear  and  their  probability  distributions  are  Gaussian).  In  addition, 
we  perform  sensitivity  analyses  for  the  linear  Gaussian  case  to  gain  some  insight  into  the 
behavior  of  the  team.  Varying  key  parameters  such  as  the  quality  of  the  observations  that 
the  decision  makers  receive  and  the  a  priori  probabilities  of  the  hypotheses,  we  see  the 
effect  this  has  on  the  performance  of  the  team. 

Finally,  the  results  for  the  General  K  case  are  presented,  where  the  number  of 
messages  used  by  DMA  (i.e.,  K)  can  take  on  any  value.  This  provides  the  framework  to 
evaluate  the  performance  of  a  team  that  uses  K  messages  for  communication  between  DMA 
and  DMB.  Increasing  the  communication  between  the  team  members  in  this  manner  results 
in  the  performance  of  the  team  approaching  that  of  the  centralized  version  of  the  problem, 
where  a  single  decision  maker  receives  two  independent  observations. 
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(a)  Two-message  (K=2)  Tandem  Distributed  Detection  Network,  (ua  =  {Mlt  M2)) 


(b)  K-message  Tandem  Distributed  Detection  Network,  (ua  =  {Mj,  M2, ...,  M^}) 


Figure  1  Problem  Formulation 


rnfkVMiioiirr 
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Hypothesis-testing  problems  in  the  field  of  Command  and  Control  are  one  of  the  many 
areas  where  this  research  can  be  applied.  More  specifically,  we  discuss  the  target  detection 
problem  where  the  two  hypotheses,  Hq  and  HJt  are  defined  as  before.  Two  geographically 
distributed  sensors  (or  DM's)  receive  independent  noisy  measurements.  Based  on  these 
measurements,  the  team  has  to  declare  the  presence  or  the  absence  of  a  target.  The  final 
decision  of  the  team,  however,  is  made  by  the  downstream  DM  and  there  is  a  one-way 
communication  between  the  DM's  (from  DMA  to  DMB).  It  is  possible  to  allocate  different 
costs  to  the  probabilities  of  false  alarm  and  missed  detection  and  attempt  to  minimize  this 
cost,  which  in  turn  minimizes  the  probability  of  error  of  the  detection  team.  It  is  evident 
that  if  the  downstream  DM  relied  only  on  the  measurement  from  his  sensor,  we  have  a 
classical  centralized  detection  problem.  Furthermore,  if  the  upstream  DM  were  to 
communicate  his  entire  observation  to  the  downstream  DM,  we  once  again  are  dealing  with 
a  classical  centralized  detection  problem  where  the  decisive  DM  has  two  measurements  with 
which  he  can  make  the  final  decision  of  the  team.  In  the  latter  case,  however,  the 
communication  of  raw  data  is  involved  which  could  be  expensive  from  a  channel 
bandwidth  point  of  view.  In  addition,  communication  of  this  type  could  easily  be 
intercepted  by  the  enemy. 

To  minimize  the  cost  and  the  potential  risks  involved,  the  communication  mechanism 
described  in  the  previous  section  is  employed.  As  a  consequence,  communication  is  cheap 
and  is  more  likely  to  escape  enemy  interception. 

The  need  for  communicating  with  a  few  bits  rather  than  with  raw  data  can  be 
appreciated  if  we  consider  detecting  an  enemy  airplane  using  radar  as  depicted  in  Figure  2. 
We  associate  DMB  with  the  control  room  in  the  building  and  DMA  with  our  surveillance 
airplane  (both  having  means  through  which  they  can  receive  measurements).  In  this 
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Figure  2  Target  Detection  Example 
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situation,  a  short  communication  message  can  be  used  to  transmit  the  surveillance  aircraft 
message  to  the  ground  center,  who  in  turn  makes  the  final  decision  of  the  team. 

Although  the  primary  motivation  for  this  research  stemmed  from  military  surveillance 
problems,  distributed  detection  problems  are  also  prevelant  in  civilian  air  traffic  control 
systems  and  many  other  areas. 
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The  area  of  distributed  detection  is  relatively  new  and  there  are  only  a  few  papers  that 
deal  with  solutions  to  such  problems.  One  of  the  first  papers  to  consider  the  distributed 
detection  problem  was  the  paper  by  Tenney  and  Sandell  [5].  They  demonstrated  the 
difficulties  encountered  in  solving  a  two-sensor  problem,  and  showed  that  the  optimal 
decision  rule  for  each  sensor  is  deterministic  and  is  a  likelihood  ratio  test.  The  decision 
thresholds  were,  in  general,  coupled.  Eckhian  [1]  analyzed  the  decision  rules  for 
Distributed  Detection  Networks  and  investigated  organizational  issues  in  such  networks. 
He  derived  the  solution  to  the  two-sensor  problem  where  DMA  uses  two  messages  (K  =  2) 
to  communicate  with  DMB.  The  problem  where  DMA  uses  more  than  two  messages  (K  = 
3,  4,  ...),  however,  has  not  been  solved  as  yet.  He  also  considered  problems  in  which 
more  than  two  sensors  made  a  team.  Eckhian  and  Tenney  [2]  pointed  out  that  individual 
DM's  make  decisions  based  on  their  own  observations  and  decisions  passed  down  by  the 
"upstream”  DM’s.  In  Papastavrou  [3]  and  Papastavrou  and  Athans  [4],  the  notion  of 
communication  cost  was  introduced.  A  two-sensor  problem  was  considered  where  the 
primary  decision  maker  could  solicit  the  opinion  of  the  consulting  decision  maker  at  a  cost. 
The  final  decision,  however,  was  made  by  the  primary  decision  maker.  The  optimal 
decision  rules  were  shown  to  be  tightly  coupled  and  numerical  sensitivity  analyses 
provided  valuable  insight  on  the  overall  behavior  of  the  team.  Tsitsiklis  [6]  and  Tsitsiklis 
and  Athans  [7]  dealt  with  distributed  hypothesis-testing  problems  and  showed  that  they 
were  NP-complete;  they  demonstrated  the  computational  complexity  of  solving  optimal 
distributed  decision  problems  while  showing  that  the  solutions  to  the  centralized  versions 
were  trivial.  Kushner  and  Pacut  [9]  introduced  a  delay  cost  (somewhat  similar  to  the 
communications  cost  in  [3]  and  [4])  in  the  case  where  the  observations  have  exponential 
distributions.  They  performed  a  simulation  study  and  presented  the  results.  In  Chair  and 
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Varshney  [10],  the  results  of  [5]  have  been  extended  to  more  generalized  settings. 
Boettcher  [11]  and  Boettcher  and  Tenney  [12],  have  shown  how  to  modify  the  normative 
solutions  in  [2]  to  reflect  human  limitation  constraints,  and  arrive  at  a  normative/descriptive 
model  that  captures  the  constraints  of  human  implementation  in  the  presence  of  decision 
deadlines  and  increasing  human  workload;  experiments  using  human  subjects  showed 
close  agreement  with  the  prediction  of  their  normative/descriptive  model.  In  Reibman  and 
Nolte  [13],  using  the  minimal  global  cost  criterion,  it  is  shown  that  the  optimal  structure  of 
the  local  processor  in  a  general  distributed  detection  network  is  a  likelihood  ratio  test  when 
the  input  observations  are  statistically  independent.  In  addition,  it  is  shown  that  the  local 
thresholds  and  the  network  performance  can  be  expressed  as  a  function  of  the  receiver 
operating  characteristics  (ROCs)  of  the  local  processors.  The  performance  of  five 
distributed  nerworks  are  compared  numerically  using  local  ROCs  from  the  conic  ROC 
family.  Vishwanathan,  Thomopoulos  and  Tumuluri  [14]  consider  a  serial  distributed 
decision  scheme  (also  called  a  tandem  network)  and  carry  out  a  performance  analysis  of 
such  a  scheme  to  compare  it  to  the  performance  of  a  parallel  decision  scheme.  Finally, 
Polychronopoulos  [15]  dealt  with  the  decentralized  detection  problem  in  which  a  large 
number  of  identical  sensors  transmit  a  finite-valued  function  of  their  observations  to  a 
fusion  center  which  then  decides  which  one  of  the  M  hypotheses  is  true.  An  asymptotically 
optimal  solution  to  the  problem  is  presented  for  the  case  where  observations  are  generated 
from  one  of  a  simple  set  of  discrete  symmetric  distributions. 
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L*  ^oninounons  oi  ims  nesearcn 

Through  this  research,  we  see  the  degree  of  improvement  in  the  performance  of  the 
detection  team  when  DMB  (the  decision  maker  making  the  final  decision  of  the  team)  is 
given  more  information  than  if  it  were  operating  in  isolation.  When  operating  in  isolation, 
DMB  has  its  own  observation  yp,  with  which  to  make  a  decision.  We  now  provide  a 
message  from  DMA  to  assist  DMB  in  making  a  more  accurate  decision.  The  optimal 
decision  thresholds  with  the  DM's  operating  as  a  team  are  different  from  those  of  DMB 
operating  in  isolation.  In  particular,  these  decision  thresholds  are  tightly  coupled.  Hence, 
DMA  and  DMB  are  operating  as  team  members.  We  see  the  difference  in  the  performance 
of  the  team  if  DMA  can  use  three  messages,  as  opposed  to  two  messages,  to  assist  DMB. 
As  expected,  the  three  message  case  provides  more  information  to  DMB  (regarding  DMA's 
observation),  and  the  performance  is  better. 

On  the  other  hand,  we  compare  the  overall  distributed  team  performance  to  that  of  the 
centralized  version  of  the  problem,  in  which  DMB  has  access  to  both  sets  of  observations, 
ya  and  yp.  This  shows  the  performance  degradation  due  to  enforcing  the  distributed 
decision  making  process.  If  the  number  of  messages  used  by  DMA  is  increased  to  four, 
we  see  that  the  performance  of  the  team  gets  closer  to  that  of  its  centralized  counterpart.  If, 
for  instance,  the  number  of  messages  used  by  DMA  is  allowed  to  approach  infinity,  it  is 
expected  that  the  performance  of  such  a  scheme  would  approach  that  of  the  centralized 
version.  However,  we  see  that  there  is  not  much  room  for  improvement  in  performance 
beyond  the  use  of  two  bits  of  information. 

The  overall  behavior  of  the  team  is  studied  by  varying  the  quality  of  the  observations  of 
the  decision  makers  and  the  a  priori  probabilities  of  the  hypotheses.  This  study  is  very 
informative  and  answers  questions  regarding  the  positioning  of  the  DM's  (i.e.,  upstream  or 
downstream),  and  the  allocation  of  communication  capability  to  the  DM's  (depending  on 
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whether  the  decision  maker  is  "smart"  or  not).  It  also  shows  how  the  team  members 
operate  intuitively  and  in  the  best  interest  of  the  team. 
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Chapter  2 

THE  GENERAL  PROBLEM 


In  this  chapter  we  extend  the  well-known  two-message  case  to  one  where  three 
messages  are  used  by  DMA  to  communicate  with  DMB.  In  addition  to  summarizing  the 
results  of  the  three-message  case,  we  also  include  the  results  of  the  two-message  case  for 
the  sake  of  completeness.  Once  we  have  understood  the  three-message  case  completely,  in 

) 

Chapter  4  we  will  further  extend  the  problem  to  one  where  four  or  even  K  messages  (K 
taking  on  any  value)  are  used  for  communication  by  a  detection  team. 

I 

2d  Notation 

The  problem  studied  is  one  of  hypothesis  testing,  where  the  detection  team  has  to 
choose  between  two  hypotheses,  Hq  and  Hlf  with  a  priori  probabilities 

P(Hq)  and  PCHj) 

Each  of  the  two  decision  makers,  DMA  and  DMB,  receives  an  uncertain  measurement 
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ya  and  yp  respectively,  distributed  with  known  joint  probability  density  functions 

P(ya>  yp  1  Hi)  for  i  =  0, 1 

The  objective  of  the  decision  strategies  is  to  minimize  the  expected  cost  incurred,  where 
the  minimization  is  done  over  the  decision  rules  of  the  two  decision  makers.  The  cost 
function  is  written  as  J(up,  Hj),  and  is  the  cost  incurred  by  the  detection  team  choosing  up, 
when  Hj  is  the  true  hypothesis. 

2.2  Assumptions 

Assumption  1  :  J(1,H0)  >  KO.Hq)  ;  KO.Hq)  >  Jd.Hj)  (1) 

or  the  cost  incurred  for  making  an  error  is  greater  than  that  for  being 
correct. 

This  logical  assumption  is  made  in  order  to  motivate  the  team  members  to  avoid 
making  errors  and  in  order  to  enable  us  to  put  the  optimal  decisions  in  the  form  of 
likelihood  ratio  tests. 

Assumption  2  :  P(ya  I  yp,  Hj)  =  P(yp  I  Hj) ;  P(yp  I  ya,  Hj)  =  P(yp  I  H,)  for  i  =  0,  1  (2) 
or  the  observations  ya  and  yp  are  conditionally  independent. 

This  implies  that  one  observation  is  not  dependent  on  the  other  and  enables  us  to 
write  the  optimal  decision  rules  as  likelihood  ratio  tests  with  constant  thresholds. 

Assumption  3  :  Without  loss  of  generality  we  assume  that 

P(u  =  M.  I  HJ  P(u  =  M,  I  H0)  P(u  =  M3  I  HJ 

a  1  0  >  a  Z  u  >  q  1  u 

P(u  =  M.  I  H.)  P(u  =  M,  I  H.)  ~  P(u  =  M_  1  H.) 

a  1  1  a  1  1  a-51 
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This  assumption  is  made  in  order  to  distinguish  between  the  messages  of  DMA. 


H  Igfcmsssags  Case 

Given  P(Ho),  P(Hj),  the  distributions  P(ya,  yp  t  H,)  for  i  =  0, 1  with  ya  e  Ya, 
yp  €  Yp,  and  the  cost  function  J(up,  Hj),  the  optimal  decision  rules  (one  that  minimizes  the 
expected  cost)  of  DMA  and  DMB  are  derived.  DMA  can  use  one  of  two  messages,  Mj  or 
M2,  to  communicate  his  decision  to  DMB.  DMB  has  his  own  observation  and  the  message 
from  DMA  to  make  the  final  decision  of  the  team. 

The  proofs  of  the  theorems  of  the  two-message  case  appear  in  Optimal  Design  of 
Distributed  Detection  Networks,  which  is  listed  in  the  References  section.  Hence,  they 
will  not  be  repeated  here. 

Theorem  1 

Given  the  decision  ua  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function 


Yp:YpX{M1,M2)  ->  (0,1) 


defined  by  the  following  likelihood  ratio  tests: 


YptyjJ-  ua)  = 


l  1  ,  otherwise 


(4) 
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where 


w  = 


P(Hq)  P(yft  I  Hp) 
P(Hj)  P(yp  I  Hj) 


(5) 


and 


P(iH  H1)[J(0,H1)-J(1,H1)] 
Pi  =  P(uqI  H0)  f  J(1,H0)  -  J(0,H0)  ] 


for  i  =  0, 1 


(6) 


Theorem  2 


Given  the  decision  up  €  {0, 1 }  of  DMB,  the  decision  rule  of  DMA  is  a 
deterministic  function 

Ya:  Ya  — »  {  Mj,  M2  }  =  {  0, 1  } 


defined  by  the  following  likelihood  ratio  tests: 


Y«(y«)  = 


1  M^,  otherwise 


(7) 


where 


P(H0)  P(yJ 

Aa(ya)-  p(H  )  P(y  IH,) 

1  a  1 


(8) 
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and 


X  J(US.H,)  [  P(u?l  u=  0,  H,)  -  P(Upl  Uo=  1.  H,)  ] 
a*  =  - - -  (9) 

X  «vHo>  i  p<v  v  '•  Ho>  -  p<v  v  °-  Ho>  i 

Although  the  structure  of  the  decision  rules  above  seem  simple,  the  computation 
of  the  thresholds  is  quite  complex.  It  is  necessary  to  solve  a  system  of  non-linear 
simultaneous  equations  since  the  threshold  equations  are  coupled.  This  can  be  done 
iteratively  using  a  computer  algorithm.  In  addition,  the  computation  of  the 
thresholds  require  certain  quantities  that  are  not  easy  to  determine.  For  example, 
the  computation  of  P0  requires  the  calculation  of  the  conditional  density 
p(ua  =  0  I  Ho),  which  requires  the  calculation  of  p(ua  =  0  I  y^  as  shown  below  : 

p(ua  =  0  I  Ho)  =  J  p(ua=  0 1  ya)  p(ya  I  H„)  dyQ  (10) 

2.4  Threfrnrcssagfisase 

Given  P(Hq),  POH^),  the  distributions  P(ya,  yp  I  Hj)  for  i  =  0, 1  with  ya  €  Ya, 
yp  e  Yp,  and  the  cost  function  J(up,  H;),  the  optimal  decision  rules  of  DMA  and  DMB  are 
derived.  DMA  can  use  one  of  three  messages,  Mj,  M2,  or  M3,  to  communicate  his 
decision  to  DMA.  DMB  has  his  own  observation  and  the  message  from  DMA  to  make  the 
Final  decision  of  the  team. 

The  detailed  proofs  of  the  theorems  for  the  three-message  case  appear  in  the  appendix. 
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Theorem  3 


Given  the  decision  Uq  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function 


yp:  Yp  x  {  Mj,  M2,  M3  }  ->{0,  1  } 
defined  by  the  following  likelihood  ratio  tests  : 


Yp(yp.Ua)  = 


0, 

.  1 ,  otherwise 


where 

P(H0)  P(yfli  Hq) 

Ap(yp)  -  P(Hi)  P(y^  Hi) 

and 


(11) 


(12) 


P(Ua=  i  I  H,)  [  J(0»  Hj)  -  J(l,  Hj)  ] 
Pi  =  P(u”=  i  I  H0)  [  J(l,  -  J(0,  Hq)  ] 


for  i  -  Mj,  M2,  M3  (13) 


Theorem  4 

Given  the  decision  up  €  {0, 1 }  of  DMB,  the  decision  rule  of  DMA  is  a 
deterministic  function 

Ya:  Ya  — »  {  Mj,  M2,  M3  ) 
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defined  by  the  following  likelihood  ratio  tests: 


M  ,  if  A  (y  )>  a 

1  a  a  1 

M  ,  if  a  <  A  (y  )  <  a 

2  3  a  a  1 


l  M3,  ifAa(ya)<a 


(14) 


where 


P(H0)  p(yJ  H0) 
Aa(y«)  -  p(H})  P(yJ  Hj) 


(15) 


and 


X  J<V  Hl>  [  p(up'  Ua=  M2’  Hl>  -  p(up'  Ua=  Ml’  Hl>  1 

ttj  =  - - -  (16) 

X  Ho)  [  Ua=  .  Ho)  -  V  M2’  H0>  1 

X  J(up.  Hj)  [  P(Upl  ua=  M3 .  Hl)  -  P(UPI  ua=  Mj.H,)) 

03=-^ -  (17) 

X  J(up.  H0)  [  P(upl  ua=  M,  ,  H0)  -  P(UjJ!  ua=  M3  ,  H0)  ] 


Once  again,  the  nature  of  the  above  equations  neccessitates  an  iterative  solution. 
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Chapter  3 

THE  GAUSSIAN  CASE 


This  chapter  contains  the  detailed  threshold  equations  for  the  cases  where  the 
observations  of  DMA  and  DMB  arc  linear  and  their  probability  distributions  are  Gaussian. 
The  Gaussian  distribution,  despite  its  cumbersome  algebraic  formulae,  is  chosen  due  to  its 
generality. 

3.1  The  Gaussian  Problem 


The  distribution  of  the  observations  of  the  decision  makers  are  Gaussian  and  are  given 


by 


ya  ~  N(n,  ca2)  ;  yp  ~  Nfti,  op2) 


(18) 


The  hypotheses,  namely  Hq  and  Hj,  are  described  by 


H0  :  ;  Hj  :  M-  =  ^ 


(19) 


It  is  assumed  that  n0  <  |i.j  (with  no  loss  of  generality). 
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It  can  be  shown  that  the  decision  thresholds  for  the  Gaussian  case  are  on  the 
observation  axes.  These  thresholds  appear  in  Figure  3.  For  the  two-message  case,  the 
thresholds  are  referred  to  as  Ya*.  YpMi  and  YpM2  (where  refers  to  the  only  threshold  of 
DMA).  For  the  three-message  case,  the  thresholds  are  referred  to  as  Ya’,  Yau,  YpMi, 
YpM2  and  YpM3  (where  T  and  'u'  refer  to  the  lower  and  upper  thresholds  of  DMA 
respectively).  The  threshold  equations  are  written  in  terms  of  the  error  function  which  is 
given  by 


<I>jj  (k)  =  J  (27t)'°-5  exp(-0.5x2)  dx  (20) 


where  i  =  a,  (3 

j  =  *,M1,M2  for  K  =  2 

=  1,  u,  Mlf  M2,  M3  for  K  =  3 
k  =  0,  1 


It  is  useful  to  note  that  the  centralized  maximum  likelihood  estimations  of  the  thresholds 
are  given  by 


DMA: 


u.  +  u. 

L0 _ LL 


P(H0) 

1  -  P(H0) 


(21) 


DMB  : 


yML 


u  +  u 
12 _ 11 


P(H0) 

1  -  P(H0) 


(22) 
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These  are  the  estimations  of  the  thresholds  in  an  isolated  setting  (i.e.,  DMA  or  DMB  in 


isolation  rather  than  as  team  members). 


22  -Tm-message-Cass 

The  decision  rules  that  follow  are  applicable  to  the  case  where  DMA  uses  two 
messages,  M!  and  M2,  to  communicate  with  DMB. 

A  discussion  for  the  corollaries  of  this  case  appears  in  the  appendix. 

Corollary  1 


Given  the  decision  Ua  by  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function  defined  by 


Yp(yp,  O  = 


0,  ifyp<;Y 

i.  tfyp>Y 


Ms 

k 


P 


for  i  =  1,  2 


(23) 


where 


•> 


+ 


P(H0) 

1  -  P(H0) 


K  +  V- 


(24) 


1  -<t>’(0) 

a 

l-d)*(l) 

a 


+ 


P(H0) 

1  -  P(H0) 


u  +  (I 
+  Q  1 


(25) 
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(b)  Three-message  case 


Figure  3  The  Gaussian  Example 
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Corollary  2 


Given  the  decision  up  of  DMB,  the  optimal  decision  rule  of  DMA  is  a  deterministic 
function  defined  by 


Ya(y<x)  * 


Mi’  ify 

1  a  a 

U2,  ify  >Y* 
*  a  a 


(26) 


where 


1 

M,  M, 

<dr  (0)  -  d>ft  2(0) 

>1 

\ 

r  p(Ho>  l 

i  =  - * - in 

a  n  -\l 

1 

M.  M, 

O  ‘(D-O  2(1) 

L  p  P  J 

t - - - in 

U  -  LI 
*1 

1  -  P(H0) 

u  +  u. 

+  -Q—L  (27) 


The  coupling  of  the  equations  appearing  in  Corollary  1  and  Corollary  2  can  be  seen  by 
writing  out  the  error  functions  using  the  definition  in  Section  3.1. 


V* 


a 

Oa*  (k)  =  J  (Ik)  0  5  exp(-0.5  x2)  dx  for  k  =  0,  1 


(28) 


vM' 

Ya 


d>pMi  (k)  =  J  (2rc) 0  5  exp(-0.5  x2)  dx  for  k  =  0,  1 


(29) 


OpM2  (k)  =  J 


(27c) 0,5  exp(-0.5  x2)  dx  for  k  =  0,  1  (30) 
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Hence,  we  f,ee  that  both  YpMi  and  YpM2  are  functions  of  Ya*,  which  in  tum  is  a 
function  of  both  YpMi  and  YpM2.  The  equations  are,  therefore,  tightly  coupled. 


3  J  Three-message  Case 


The  decision  rules  that  follow  are  applicable  to  the  case  where  DMA  uses  three 
messages,  M1?  M2  and  M3,  to  communicate  with  DMB. 

The  corollaries  of  this  case  have  been  proven  to  illustrate  how  the  Gaussian  equations 
are  derived.  These  proofs  appear  in  the  appendix. 

Corollary  3 


Given  the  decision  ua  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function  defined  by 


Yp(yp.  ua)  = 


where 


for  i  =  1, 2,  3 


(31) 


M1  ^ 

KH 

O2 

■  6  i— 

'  P(H0)  1 

=  - = — in 

P  U  -a 

o‘(1) 

+ - ■ —  in 

u  -u 

M  ^0 

1  -  P(H0) 

- 

u.  +  |i 
*0  1 


(32) 


M2 

Ou(0)-O!  (0) 
_ 2 _ a 

O2 
.  B 

■  P(H0)  ' 

Y  =  - 2 — in 

“  4  -  ji 

M  ^0 

Ou(l)-Ol(l) 

a  a 

+ - - —  in 

1  -  P(H0) 

Li  +  U 
*0  _1 


(33) 
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M3  O* 

1  -Ou(0) 
_ a _ 

a2 

.  3  i— 

r  p(Ho)  1 

Y  =  - “ — In 

P  U.  -  11 

1-<DU(1) 

a 

+  "  in 

^0 

1  -  P(H0) 

u  +  u. 

+  LQ _ _L 


(34) 


Corollary  4 


Given  the  decision  up  of  DMB,  the  optimal  decision  rule  of  DMA  is  a  deterministic 
function  defined  by 


f  M.,  if y  <Y[ 

I  1  a  a 

Ya(ya)=  \  M.  ,  if  Y1  <  y  <YU 
2  a  a  a 

.  M3,  if  y  >  Y“ 

J  a  a 


(35) 


where 


Y1  = 


a2 

QC 

M,  M, 

(0)'°R  (0) 

a2 

'  P(Ho)  ‘ 

- - — In 

M,  M, 

Op2(l)-<Dpl(l) 

+ - - — in 

^0 

1  -  P(H0) 

-  (36) 


Y11 

a 


a2 

a  iM 

r  _,m, 

fs_ 

M, 

(0)-<D  2(0) 

_ B - 

a2 

,  a 

'  p(Ho)  ' 

- — —  In 

^0 

M, 

V 

M, 

(D-O'd) 

p  J 

+ - — —  in 

1  -  P(H0) 

~  (37) 


Having  listed  the  error  functions  in  detail  for  the  two-message  case,  we  can  see  by 
inspection  that  the  equations  for  the  three-message  case  are  also  coupled  in  the  similar 
manner. 


I 
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3.3  Computation  of  Thresholds 

It  is  clear  that  the  threshold  equations  for  both  the  two-message  and  three-message 
cases  are  coupled.  However,  the  equations  can  be  solved  numerically  using  an  iterative 
method.  This  iterative  method  is  implemented  using  a  computer  algorithm  that  receives  as 
input  initial  estimates  of  the  thresholds  of  the  downstream  decision  maker,  and  yields  the 
optimum  thresholds  for  both  decision  makers.  In  other  words,  for  the  three-message  case, 
the  algorithm  is  given  initial  estimates  of  YjjMi,  YpM2  and  YpM3.  It  then  computes  Ya!  and 
Yau  using  these  estimates  and  completes  one  iteration.  Given  Ya!  and  Yau,  the  thresholds 
of  the  downstream  decision  maker  are  computed  and  this  iterative  process  is  carried  on  until 
the  threshold  values  converge  (i.e.,  the  values  from  the  Nth  iteration  have  not  changed  by 
more  than  a  specified  percentage  from  those  of  the  N-lst  iteration).  The  solutions  have 
found  to  be  unique  (i.e.,  they  are  not  merely  locally  optimal). 

The  algorithm  was  coded  using  Microsoft  Basic.  Due  to  the  nature  of  the  program  it  is 
essential  that  the  initial  estimates  of  the  downstream  decision  maker  be  unequal.  Equal 
estimates  would  result  in  the  program  terminating  in  one  iteration.  Although  the  number  of 
iterations  required  for  convergence  depends  on  the  initial  estimates  provided  to  the 
program,  a  typical  computation  usually  takes  about  15-20  iterations. 

The  two-message  case  entails  solving  a  system  of  three  equations  (i.e.,  (25)-(26)  and 
(28))  while  the  three-message  case  involves  solving  five  equations  (i.e.,  (33)-(35)  and 
(37)-(38)). 

In  order  to  get  numerical  results,  the  following  baseline  parameter  values  were  used  for 
the  problem : 


Under  Hq  :  p.  =  p0  =  0  ca2=100 

Under  H! :  p.  =  (ij  =  10  a^2=100 

P(Ho)  =  0.5 
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Using  the  values  on  the  previous  page,  the  thresholds  for  the  two-message  and  three- 


message  cases  are  computed. 


Two-message  Case  : 


Y 


a 


=  5.0 


M.  M, 

Y  =  13.0697  Yq  =  -3.0697 

p  p 


Three-message  Case  : 


Y1  =  -0.1922  Yu  =  10.1922 

a  a 

M,  M,  M3 

Yp1  =  16.6188  Yp2  =  5.0  Yp  = 


-6.6188 
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Chapter  4 

THE  EXTENDED  PROBLEM 


The  general  problem  is  extended  to  cases  where  the  number  of  messages  used  by  the 
upstream  decision  maker  is  greater  than  three  (i.e.,  K  >  3).  More  specifically,  in  this 
chapter  we  consider  the  four  message  case.  Both  the  general  problem  and  its  Gaussian 
version  have  been  studied.  Results  for  the  case  where  K  can  take  on  any  value  are  also 
presented. 

4.1  The  EQur.-messrse  Case 

Given  P(Ho),  PCHj),  the  distributions  P(ya,  yp  I  H;)  for  i  =  0,  1  with  ya  e  Ya, 
yp  €  Yp,  and  the  cost  function  J(up,  Hj),  the  optimal  decision  rules  (one  that  minimizes  the 
expected  cost)  of  DMA  and  DMB  are  derived.  DMA  can  use  one  of  four  messages,  Mlt 
M2,  M3  or  M4,  to  communicate  his  decision  to  DMB.  DMB  has  his  own  observation  and 
the  message  from  DMA  to  make  the  final  decision  of  the  team. 

The  assumptions  for  the  four-message  case  are  the  same  as  those  for  the  three-message 
case  (a  four-message  version  of  Assumption  3  is  used).  The  proofs  of  the  theorems  in  this 
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section  have  not  been  included  in  the  appendix  since  they  are  similar  to  those  for  the  three  - 
message  case. 


Thggrs.S)  5 


Given  the  decision  Uq  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function 


yp:  Ypx{M1,M2,M3,M4}  ->{0,1} 
defined  by  the  following  likelihood  ratio  tests  : 


0,  ifA^sp. 

1 ,  otherwise 


(38) 


where 

pcHq myJHo> 

AP(yp)  P(Hl)  P(yp|  Hj) 


(39) 


and 


_P(u=ilH1)[J(0,  Hj)  -  J(l,  Hj)  ] 
‘  “  P(ua=  i  I  H0)  [  J(l,  -  J(0,  H0)  ] 


for  i  =  Mj,  Mj,  M4  (40) 
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Theorem  6 


Given  the  decision  ug  e  {0, 1 }  of  DMB,  the  decision  rule  of  DMA  is  a 
deterministic  function 

Ya  •'  Ya  — >  {  Mj,  M2.  M3,  M4  } 

defined  by  the  following  likelihood  ratio  tests: 


M.  ,  if  A  (y  )>a 
‘  a  a  1 

M  if  «  *  A  (y  )  <  a 

Y«(yJ  =  4  “  “  1 

|  M3’  if“6SA„<ya)<a4 

l  M4,  ifAo(yo)<o6 


(41) 


where 

P(H0)  P(yJ  Hq) 
A«( y“)  ~  P(H1)  P(y  I  Hj) 


(42) 
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(44) 


X  Hi}  [  P(V  v  ^  •  Hi}  - P(V  v  m2  -  Hi}  ] 

^ - 

X  J(UP’  H0>  f  P%'  V  **2  '  H0>  -  P(V  V  M3  ■  H0>  1 

X  J(iy  Hj)  [  j(up  I  ua=  M4,  H,)  -  P(up  I  ua=  M3,  Hj)  ] 

a6  =  ^ -  (45) 

X  J<V  Ho)  [  P<up  1  V  M3.  H0)  -  P(up  I  ua=  M4,  H0)  ] 

4.2  Gaussian  Version  for  K  =  4 

The  decision  rules  that  follow  are  applicable  to  the  case  where  DMA  uses  four 
messages,  M1?  M2,  M3  and  M4,  to  communicate  with  DMB. 

The  decision  thresholds  for  the  Gaussian  case  are  once  again  on  the  observation  axes 
and  can  be  seen  in  Figure  4.  For  the  four-message  case,  the  thresholds  are  referred  to  as 
Ya',  Yam,  Yau,  YpMi,  YpM2,  YpM3  and  YpM4  (where  T,  'm'  and  'u'  refer  to  the  lower, 
middle  and  upper  thresolds  of  DMA  respectively).  The  threshold  equations  are  written  in 
terms  of  the  same  error  function 

OjJ  (k)  =  J*  (27t)’°5  exp(-0.5x2)  dx  (46) 
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m3 
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m4 

(a)  Decision  Thresholds  for  DMA 


vm4 

in 


VM, 

V 


(b)  Decision  Thresholds  for  DMB 


Figure  4  Gaussian  Example  for  K  =  4 
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where  i  =  a,  (3 

j  =  1,  m,  u,  M,,  M2,  M3,  M4 
k  =  0,  1 

A  discussion  for  the  corollaries  of  this  case  appears  in  the  appendix. 


Corollary  5 


Given  the  decision  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function  defined  by 


Mi 

0,  if y  <Y0 

Yp(yp.u«>=  -j  e  I, 

1 


fori  =  1,  2,  3,  4 


(47) 


where 


M1  °«2 

^(0) 
_s _ 

a2 

i  B 

r  p(H0) ' 

y - * —  in 

**  LL  —  LL 

*1  M) 

<^(1) 

a 

*r  *= —  in 

1  -  P(H0) 

+  2 -  (48) 

M, 


0  in 

Om(0)  -  O1  (0) 
a  a 

_ 6 _  Ir. 

p(H0)  1 

Lt  —  U 

Om(l)  -  O1  (1) 
a  a 

H 

JP 

1 

*■ 

>—* 

t 

/-s 

X 

o 

'w' 

+  -V-1-  (49) 


M3  °R 

Y. 3  = - in 


P 


u  -  u 


$u(0)  -  Om(0) 

a  a 

oz 

i-  0  In 

[  p(Ho)  1 

It  +U. 

,  'o  M 

d>u0)-<Dm(i) 

a  a 

T  r  111 

11  -  u 

M  'o 

1  -  P(H0) 

2 

(50) 
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M4  O2 

•v  _  B  i  — 

s 

e° 

i 

t _ 

c2 

i  B  iM 

i - 

O 

X 

cC 

1 _ 

Y  -  - B — In 

V*1. 

1  -<DU(1) 

L  a  - 

-t - - —  in 

^0 

_1-P(H0)J 

K+4 


(51) 


Corollary  6 

Given  the  decision  up  of  DMB,  the  optimal  decision  rule  of  DMA  is  a  deterministic 
function  defined  by 


Ya(ya)  = 


,1 

a 


M,  ,  ify  <  Y 
1  a  i 

M,,  if Y1  <y  SY™ 
L  a  a  a 

M.  ,  if  Ym  <  y  ^YU 
^  a  a  a 

l  m4,  if  y_  >  y“ 


(52) 


a  a 


where 


Y1  = 

a 


a2 

M,  M, 

oR2(°)-o '(0) 
— 2 2 

a2 

’  P(Ho)  ' 

- “ — in 

u  -  u 

M  0 

M,  M, 

^  (i)-®  *(i) 

L  P  P  J 

+  — » —  m 

a  -  li 

M  *0 

1  *  P(H0) 

+  -iL^~L(53) 


yn 

a 


a 


Li  -U. 
*1  *0 


-In 


Mi  Mj 

°R  (0)  '  °R  (0) 
M,  M, 

V0)-V(1) 


Li  -  (I 


■In 


P(H0) 


1  -  P(H0) 


(54) 


Y“  = 


a2 

a  In 

M4  M, 

0R4(0)-CDR3(0) 

a2 

f  a  In 

\  Wo>  1 

^0 

M4  Mj 

Lv^-Vil 

^l'^0 

1 

o 

X 

w 

a, 

i 

4  +*i 


(55) 
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The  threshold  equations  for  this  case  are  also  coupled.  They  are  solved  using  the 
iterative  method  described  in  the  previous  chapter.  The  four-message  case  involves  solving 
a  system  of  seven  non-linear  simultaneous  equations. 

In  order  to  get  numerical  results,  the  parameters  of  the  problem  are  assigned  values  that 
appear  in  Section  3.3.  The  thresholds  for  the  four-message  case  are  computed.  The  results 
are  shown  below. 

Four-message  Case : 


Y1 

=  -3.15  Ym 

=  5.0 

Yu  =  13.15 

a 

a 

a 

M, 

M, 

M, 

m4 

Y  =  18.845 4 

Y  =  8.8548 

=  1.1442  Y0  =  -8.8462 

P 

P 

P 

P 

A  comparison  of  the  thresholds  of  DMA  for  the  two-message,  three-message  and  four- 
message  cases  appears  in  Figure  5.  The  following  observations  regarding  the  behavior  of 
the  thresholds  are  made  : 

(i)  The  thresholds  for  the  four-message  case  consist  of  one  threshold  placed  on  either 
side  of,  and  equidistant  from,  the  stationary  threshold,  Ya*.  for  the  two-message 
case. 

(ii)  The  thresholds  of  the  three-message  case  are  pulled  apart  (each  by  the  same 
amount)  and  the  stationary  threshold,  Ya\  is  placed  exactly  in  the  middle  to  give 
the  thresholds  for  the  four-message  case. 
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-3.15 


5.0 


13.15 


(c)  Four-message  Case 


Figure  5  Threshold  Comparison 
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(iii)  We  can  make  conjectures  about  the  positions  of  the  thresholds  for  cases  where 

K  =  6,  8,  10  and  so  on.  The  thresholds  for  the  six-message  case,  for  example, 
would  consist  of  one  threshold  placed  on  either  side  of ,  and  equidistant  from,  the 
three  stationary  thresholds  for  the  four-message  case. 

(iv)  We  can  also  make  conjectures  about  the  positions  of  the  thresholds  for  cases 
where  K  =  5, 7, 9  and  so  on.  The  thresholds  for  the  five-message  case,  for 
example,  would  consist  of  one  threshold  placed  on  either  side  of ,  and  equidistant 
from,  the  two  stationary  thresholds  for  the  three-message  case. 


4.4  The  General  K  Case 

In  this  section  we  present  results  for  the  general  problem  where  K  messages  (K  can 
take  on  any  value  greater  than  two)  are  used  by  DMA  to  communicate  his  decision  to  DMB. 

Given  P(Hq),  P(Hi),  the  distributions  P(ya,  yp  I  Hj)  for  i  =  0,  1  with  ya  6  Ya, 
yp  e  Yp,  and  the  cost  function  J(up,  Hj),  the  optimal  decision  rules  (one  that  minimizes  the 
expected  cost)  of  DMA  and  DMB  are  derived.  DMA  can  use  one  of  K  messages,  Mj,  M2, 
M3, ...,  MK,  to  communicate  his  decision  to  DMB.  DMB  has  his  own  observation  and  the 
message  from  DMA  to  make  the  final  decision  of  the  team. 

The  detailed  proofs  of  the  theorems  for  the  K-message  case  appear  in  the  appendix. 

Theorem  7 

Given  the  decision  ua  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function 
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yp:  Yp  x  {  Mlt  M2,  M3, ....  Mk  }  ->{0,1} 


defined  by  the  following  likelihood  ratio  tests  : 


Yp(yp,  ua)  = 


j°, 

l  1  ,  otherwise 


where 


Pay  P(y  I H0) 

Ap(yp)  -  p(Hi)  P()y  Hi) 


(56) 


(57) 


and 


P(un=  i  I  Hj)  [  J(0,  Hj)  -  J(l,  Hj)  ] 
^  ~  P(ua=  i  I  H0)  [  J(l,  Hq)  -  J(0,  Hq)  ] 


for  i  =  Mj,  M2,  M3 . Mk 


Theorem  8 

Given  the  decision  up  €  {0, 1 }  of  DMB,  the  decision  rule  of  DMA  is  a 
deterministic  function  * 

ya •  Ya  -*  {Mi,M2,M3 . MK) 

defined  by  the  likelihood  ratio  tests  on  the  following  page. 


(58) 
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'  Mi ,  if  AQ(ya)  S  a{ 

M2,  ifa2<SAa(ya)<ai 


(59) 


mk-i  ’  “k-i  ^  <  ^-2 

'  MK-  K  “k-I 


where 


P(H0)  P(y„l  Ho) 

Aa(ya)  =  P(H  )  P(y  |H) 
1  a  1 


(60) 


and 


X  J<up’  Hl)  f  P^fj1  Ua=  M2’  Hl>  -  P^p1  V  Ml’  Hl}  1 

-  (61) 

X  %  Ho)  t  P(upl  ua=  Mj.  H0)  -  P(u  I  u-  M2,  Hq)  ] 

* 

X  «v  Hi)  t  p%'  v  ^  ■  P(V  v  m2  -  ] 

-  (62) 

J(Up,  Hq)  [  P(Upl  U^=  ,  Hq)  -  P(U  I  U^=  Mj  ,  Hq)  ] 
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(63) 


X  *V  '  J<US  1  V  M4-  Hl>  -  P<Uf, 1  V  M3’  H,> ) 


X  «U  Hq)  [  P(us  I  u-  M,,  H0)  ■  P(UP  I  u-  M4,  H0)  ] 


X  «V  Hi>  l  p%  1 V  MK'  hi>  -  p%  1 V  MK.r  H1> ) 
_ 

X  «»„.  H„)  [  P(UP  I  u-  MK1,  H„>  -  P(up  I  u-  Mk,  H„)  ] 


(64) 


4,5  Gaussian  Version  for  Any  K 

The  decision  rules  that  follow  are  applicable  to  the  case  where  DMA  uses  K  messages 
(K>2),  M2,  M3, Mk,  to  communicate  with  DMB. 

A  discussion  for  the  corollaries  of  this  case  appears  in  the  appendix. 

CgroliaryJ 

Given  the  decision  ua  of  DMA,  the  optimal  decision  rule  of  DMB  is  a  deterministic 
function  defined  by 
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M; 


O.ifySY1  for  i  =  1,  2,  3, ....  K 

Yp(yp.ua)=  p  h. 


(65) 


where 


M1  °a2 

=e- 

o 

_ _ 1 

Q 

®  M 

r 

r  p(Ho>  i 

Y  „  =  - H —  In 

ft  (i  -  (i 

<J>’  (1) 

L  o 

f - * - ill 

1  -  P(H0) 

Li  +  Li 
H)  *1 


(66) 


M2  | 

Y  2  = - 2 — In! 

2  u  -  fj. 


<D2(0)  -  O1  (0) 
a  a 

C2 

+  B  ]n 

r  p(H0> ' 

Li  +  u 
.  M 

02(l)-0l  (1) 

L  a  a  J 

^i-^o 

1  -  P(H0) 

2 

(67) 


M3  at  , 

Y  3  - - ft—  ini 

ft  u.  -  n 


<D3  (0)  -  <D2(0) 

a  a 

°a 

+ .  B  in 

'  P(H0)  ' 

+v*l 

<D3(1)-<D2(1) 

a  a  j 

>— * 

l 

X 

o 

1 _ 

2 

(68) 


M 


K-l 


0? 

B  in 

<Dk'1(0)  -  <DK'2(0) 
a  a 

c2 

+  B  ip 

P(Hq)  ' 

u  +  u. 

,  'O  M 

0K1(1)  -  Ok'2(1) 
a  a 

Li  -  Li 
*1 

1  -  P(H0) 

+  2 

—(69) 


mk 

y*  = 


a2 

ft  In 

1  -  cDK4(0) 

a 

a2 

i  ft  In 

r  p(h0)  ^ 

u  +  (I 
,  'O  1 

^0 

1  -<DK4(1) 

a 

Li  -  Li 

1  -  P(H0) 

2 

(70) 
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Given  the  decision  of  DMB,  the  optimal  decision  rule  of  DMA  is  a  deterministic 
function  defined  by 


Ya(y«)  = 


M,  ,  if  y  £  Y1 
1  a  a 

M,,  if Y1  <y  <Y2 

*■  a  a  a 

M  ,  if  Y2  <  y  <Y3 
.3  a  :  a  a 


M  ifYK'2<y  <  YK  1 
K-i  a  a  a 

rK-1 


M  ify  >V 

^  a  a 


(71) 


where 


Y1  = 


a 


^0 


■In 


Y2  = 


■In 


M,  M, 

(0)-*B  (0) 

o2 

'Tj 

X 

o 

_ 1 

M,  M, 

%  (•)-%  (D 

+ - — In 

LL  —  LX 

M  M> 

1  *  P(Ho}_ 

M,  M, 

%  (0)-O  2(0) 

_ p  D 

O  2 

i  Ct  l- 

r  p(Ho> 

M,  M, 

Op3(l)-Op2(l) 

h - - —  In 

^0 

1  -  P(H0) 

(72) 


^n  +  M- 


L  (73) 
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Chapter  5 

PERFORMANCE  OF  THE  DETECTION  TEAM 


We  can  get  an  indication  of  how  well  a  distributed  detection  team  is  doing  by  evaluating 
its  performance.  In  this  chapter,  the  performance  is  evaluated  by  computing  the  probability 
of  error  for  the  final  team  decision  and  generating  ROC  curves  for  the  detection  team.  We 
compare  the  performances  (by  computing  the  probability  of  error)  of  the  isolation,  two- 
message,  three-message,  four-message  and  centralized  cases  to  study  the  effect  of 
increasing  communication  on  the  detection  team.  In  addition,  we  generate  ROC  curves  for 
the  two-message  and  three-message  cases  to  study  the  performance  enhancement  due  to  the 
increase  of  half  a  bit  of  informatior. 


5,1  The  Probability  of  Error 

The  computation  of  the  probability  of  error  of  the  final  decision  of  a  detection  team 
(i.e.,  the  probability  that  an  incorrect  decision  is  made)  helps  us  evaluate  the  performance 
of  the  team.  There  are  two  types  of  errors  that  the  team  could  concievably  make. 
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I  Declaring  the  presence  of  a  target  when  in  actuality  there  is  no  enemy  target  present. 
This  type  of  error  could  result  in  firing  a  missile  that  would  serve  no  purpose  and 
result  in  a  financial  loss. 

II  Declaring  the  absence  of  a  target  when  in  actuality  there  is  an  enemy  target  present. 
This  type  of  error  could  be  very  fatal  in  the  event  that  the  enemy  detects  you  and 
consequently  fires  a  missile. 

The  probability  of  error  is  expressed  as  a  function  of  the  probabilities  of  false  alarm  and 
miss  (which  is  a  function  of  the  probability  of  detection).  These  probabilities  are  defined 
below. 

Probability  of  False  Alarm  (PF) :  The  probability  that  the  team  says  that  the  target  is 
present  when  it  is  not. 

Probability  of  Miss  (PM) :  The  probability  that  the  team  says  that  the  target  is  absent 
when  it  is  present. 

Probability  of  Detection  (Pq)  :  The  probability  that  the  team  says  that  the  target  is 
present  when  it  is. 

The  Probability  of  Miss  is  a  function  of  the  Probability  of  Detection.  The  equation  that 
relates  the  two  quantities  is  given  by 

PM  *  1  *  PD  (76) 
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In  general,  the  probability  of  error  is  given  by  the  following  equation  : 

Pr(E)  =  P(Ho)PF  +  P(Hj)Pm  (77) 

Using  error  functions,  we  have  computed  the  probabilities  of  error  for  the  two- 
message,  three-message,  four-message,  isolation  and  centralized  cases.  The  equations  for 
the  general  K  case  have  also  been  presented.  The  values  used  for  the  parameters  of  the 
problem  are  identical  to  those  used  in  Section  3.3. 

Two-message  Case 

Given  that  DMA  can  use  two  messages,  Mj  and  M2,  to  communicate  with  DMB, 
the  probability  of  error  is  given  by 


P(H0)  [PrfMjlH^  (l-O^(O))  +  Pr{M2IH0}  (1  -  <D^2(0))  ] 

M  M 

+  PO-Ij)  [  PrfMjIHj}  (<Dpl(l))  +  Pr(M2IHj}  2(1))  ]  (78) 

where 

Pr{M.IHn}  =  O*(0)  and  Pr{M.IH. )  =  <D*(1) 

1  U  a  I  I  a 

Pr{M2IHQ)  =  1  -  0>* (0)  and  Pr{M2IHj }  =  1  -  <D* (1)  (79) 

Note  :  PrfMjIHj)  is  the  probability  that  DMA  says  M;  given  that  the  hypothesis  H,  is 
the  true  hypothesis. 

Numerically,  Pr(E)  =  0.25758. 
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Given  that  DMA  can  use  three  messages,  M2  and  M3,  to  communicate  with 
DMB,  the  probability  of  error  is  given  by 


Pr(E)  =  P(H0)  [  Pr{MjlH0}  (1  -  <^!(0))  +  Pr{M2IH0)  (1-<D^(0)) 

+  Pr{M3IH0}  (1  -  O^3(0))  ]  +  P(Hj)  [PrfM^H,}  0^(1) 

+  PrtMjIHj}  0^(1)  +  Pr{M3IH1}  ^3(1)]  (80) 

where 


Pr{MlIHo}=^(0) 

and 

Pr{M,IH. }  =  O1  (1) 

1  1  a 

Pr{M2IH0}  =  <D“(0)  -  0^(0) 

and 

Pr{MJH.}  =  <0U(1)  -  O1  (1) 

*  1  a  a 

Pr{M3lH0}  =  1  -  O“(0) 

and 

Pr{M3IH1}  =  1  -<D“(1) 

Numerically,  Pr(E)  =  0.24779. 

Esur-ii)gasagg.Casg 

Given  that  DMA  can  use  four  messages,  Mlt  M2,  M3  and  M4,  to  communicate  with 
DMB,  the  probability  of  error  is  given  on  the  following  page. 


Pr(E)  =  P(H0)  [  Pi^MjIHq}  (1  -  0^(0))  +  Pr{M2IHQ}  (1-O^2(0)) 

+  Pr(M3IH0}  (1  -<D^3(0))  +  Pr{M4tH0}  (1  -C^4(0))  ] 

+  P(Hj)  [  PrfMjIHj}  tfJV)  +  PrfM^J  <D^2(1) 

+  Pr{M3!H1}  <D^3(1)  +  Pr{M4IHj}  <D^4(1)]  (82) 


where 


Pr{M1IH0)=O^(0) 

and 

Pr{M1IH1}=^(l) 

Pr{M2IHQ}  =  <D™(0)  -  <J>VO) 

and 

Pr{M2IH1}  =<D^(1)-O1o[(l) 

Pr{M3IH0)  =  <D“(0)  -  O™(0) 

and 

Pr{M3IH1)  =<D“(1)-<X>^(1) 

Pr{M4IHQ}  =  1-^(0) 

and 

PrfM.IHJ  =  1 -<DU(1)  (83) 

41  a 

Numerically, 

Pr(E) 

=  0.24430. 

Isolated  Case 

Given  that  DMB  is  in  isolation  (i.e.,  it  receives  no  message  from  DMA),  the 
probability  of  error  is  given  by 

P(H0)  [  1  -  0^(0)  ]  +  P(Hj)  [0^(1)]  (84) 

The  error  functions  in  the  expression  above  are  computed  using  the  formula 


54 


presented  in  Section  3.1.  However,  the  threshold  used  in  the  computation  is  given  by 


P(Ho) 

1  -  P(H0) 

J 


(85) 


Numerically,  Pr(E)  =  0.30854. 


Centralized  Case 


Given  that  DMA  can  communicate  his  entire  observation  to  DMB,  the  probability  of 
error  is  given  by 

P(H0)  [1-O£(0)]  +  P(Hj)  [<d£(1)]  (86) 

The  error  functions  in  the  expression  above  are  computed  using  the  formula 
presented  in  Section  3.1.  However,  the  threshold  used  in  the  computation  is  given  by 


yC  ^  +  . 

P  2 


<£ - b 


P(H0) 

1  -  P(H0) 


(87) 


where 


(88) 
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In  addition,  the  upper  limits  of  the  integrals  in  the  computation  of  the  error 


functions  are  given  by 


and 


respectively. 


(89) 


Numerically,  Pr(E)  =  0.23975. 

It  is  evident  that  there  is  an  inverse  relationship  between  the  increase  in  communication 
and  the  probability  of  error  of  the  detection  team.  In  particular,  the  isolation  case  has  the 
greatest  probability  of  error  associated  with  it.  When  DMA  is  allowed  to  communicate  bits 
of  information  to  DMB,  the  probability  of  error  of  the  team  decreases  with  the  increase  of 
each  half  bit  of  information.  The  numerical  value  of  the  probability  of  error  tends  to 
approach  the  centralized  version  of  the  problem  (which  has  the  least  probability  of  error 
associated  with  it). 

The  General  K  Case 

Given  that  DMA  can  use  K  messages,  Mj,  M2,  M3, ....  MK,  to  communicate  with 

DMB,  the  probability  of  error  is  given  by 

Pr(E)=P(H0)  [  PtCMjIHq)  (1  -  O^'(O))  +  Pr{M2IHQ)  (1  -  O^2(0)) 

+  Pr{M3IH0)  (1-<D^3(0))  +  ...  +  Pr{MKIH0)  (1-<D^K(0))] 

+  P(Hj)  [  PrfMjIHj)  ^^'(l)  +Pr(M2lH1}  0^(1) 

+  PrlM-jIHj}  0^3(1)  +  ...  +  PrfMjJHj)  cA(l)]  (90) 
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where 


P^MjIHq)  =  0^(0)  and 

Pr  [  ^IHq  }  =  <D  2  (0)  -  <D^(0)  and 
Pr{M3lH0}  =  <1)3  (0)  -  0^(0)  and 

Pr{M„  ,IHn}  =  0)  -  <DK‘2(0)  and 

jv-i  u  a  a 

Pr{MJHJ  =  1  -  OK4(0)  and 

K.  U  a 


Pr{M.!H,}  =<D1(1) 

11  a 

PrfM^IHj }  =<I>2(1)-<D^(1) 
Pr{M3IH1)  =C>3(1)-<d2(1) 

PrfM^.IH.}  =<DK'1(1)-<DK'2(1) 
Pr{MKIH1}  =  l-<D^1(l)  (91) 


5.2  TheRQCXuire 

The  Receiver  Operating  Characteristic  (ROC)  Curve  is  a  plot  of  PD  vs.  PF.  This  curve 
gives  us  a  good  indication  of  the  team's  performance.  It  is  derived  by  plotting  the  points 
(PF,  PD)  that  are  obtained  by  varying  a  parameter  such  as  the  decision  threshold  for  the 
team.  Given  a  specific  point  (Pp,  PD),  it  is  possible  to  derive  the  numerical  value  of  the 
Pr(E).  However,  it  is  usually  easier  to  calculate  the  Pr(E)  as  described  in  the  previous 
section.  In  general,  greater  concavity  of  the  ROC  curve  is  associated  with  better 
performance. 

Before  the  ROC  curves  for  the  detection  team  are  presented,  we  will  look  at  the  ROC 
curves  of  the  individual  decision  makers  to  give  an  indication  of  how  they  can  measure 
performance.  In  order  to  generate  the  ROC  curves  in  Figure  5,  the  decision  makers  have 
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(a)  ROC  curve  for  DMA  (ca2  =  100) 


(b)  ROC  curve  for  DMB  (op2  =  1000) 


Figure  6  Individual  DM’s  ROC  Curves 


been  placed  in  isolation  and  their  decision  thresholds  have  been  varied  to  obtain  a  set  of 
(Pp,  PD)  points.  The  means  of  the  observations  under  the  hypotheses  Hq  and  Hj  have 
been  chosen  to  be  0  and  10  respectively.  From  Figure  5  we  see  that  when  a  decision  maker 
(DMA)  has  a  better  quality  of  observations,  his  performance  is  better  than  one  whose 
observations  are  of  poor  quality  (DMB).  Not  only  is  this  deduced  by  looking  at  the 
concavity  of  the  ROC  curves,  but  it  also  makes  intuitive  sense. 

In  the  case  of  team  ROC  curves,  we  will  compare  the  curves  of  the  two-message  and 
three-message  cases  to  see  if  the  increase  in  communication  capability  has  any  effect  on  the 
team  performance.  The  points,  (PF,  PD),  for  these  curves  have  been  generated  by  varying 
the  thresholds  (which  is  accomplished  by  varying  P(Hq))  once  again,  even  though  the 
expressions  for  Pp  and  PD  are  significantly  more  complex  for  the  team  scenario.  The  ROC 
curves  for  the  two-message  and  three-message  cases  appear  in  Figure  6.  Since  it  is 
difficult  to  compare  the  curves  when  looking  at  them  individually,  we  have  superimposed  a 
portion  of  one  curve  onto  a  portion  of  another.  Looking  at  Figure  6c,  we  see  the 
performance  enhancement  we  have  achieved  by  providing  DMA  with  an  extra  half  bit  of 
communication  capability. 
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Chapter  6 

NUMERICAL  SENSITIVITY  ANALYSES 


We  now  investigate  the  behavior  of  the  detection  team  by  performing  sensitivity  studies 
to  the  solution  of  the  linear  Gaussian  example.  Our  objective  is  to  analyze  the  effects  of 
varying  the  parameters  of  the  problem  on  the  team  performance.  We  vary  the  quality  of 
observations  of  each  decision  maker  and  the  a  priori  probability  of  each  hypotheses  to  see 
the  effect  on  the  probability  of  error  and  the  thresholds  of  the  decision  makers. 

The  values  of  the  parameters  employed  in  the  sensitivity  analyses  are  the  baseline 
parameter  values  given  below. 

Under  Hq  :  |0.  =  (J.o  =  O  ca2=100 

Under  Ht  :  ji  =  p.j  =  10  Cp2  =  100 

The  value  of  P(Ho)  used  for  the  analysis  will  be  specified  for  each  case.  Also,  any 
changes  from  the  above  values  will  be  brought  to  attention. 
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Here  we  vary  P(Ho),  Ca2  and  Op2  and  see  the  effect  it  has  on  the  probability  of  error  of 
the  final  decision  of  the  team  in  the  three-message  case. 

Effects  of  varying  P(H0 )  on  the  Pr(E)  : 

In  Figure  8,  families  of  curves  (obtained  by  holding  each  of  the  variances  of  the 
observations  of  the  DM's  constant  while  varying  the  other)  have  been  presented.  It  is  clear 
that  the  Pr(E)  is  the  largest  when  there  is  the  most  prior  uncertainty  (i.e.,  when  P(Ho)  = 
0.5).  The  curves  in  Figure  8a  were  obtained  by  holding  Op2  at  100  and  varying  ca2  from 
100  to  200  (using  increments  of  25).  The  largest  value  of  the  Pr(E)  is  obtained  for  the  case 
where  aa2  =  200  and  Op2  =  100.  In  order  to  get  the  family  of  curves  that  appear  in  Figure 
8b,  oa2  is  held  at  100  while  Op2  is  varied  from  100  to  200  (once  again  using  increments  of 
25).  The  performance  is  worst  when  Oa2  =  100  and  Op2  =  200.  It  is  interesting  to  note 
that  when  DMB  is  the  "smarter"  DM  the  worst  performance  is  given  by  Pr(E)  =  0.2758. 
However,  when  DMA  is  the  smarter  DM  the  largest  error  is  given  by  Pr(E)  =  0.2779. 
Hence,  we  can  conclude  that  the  smarter  decision  maker  should  be  "downstream".  Since 
the  downstream  DM  makes  the  final  decision  of  the  team,  this  result  makes  intuitive  sense. 

Effects  of  varying  a2  and  of  on  the  Pr(E)  : 
a  p 

Figure  9a  shows  the  results  of  varying  oa2  from  100  to  5000.  There  is  a  steep  increase 
in  the  Pr(E)  initially  and  it  finally  levels  off  with  the  increase  in  oa2.  In  other  words,  there 
is  a  point  (oa2  =  5000)  beyond  which  the  performance  of  the  team  is  insensitive  to  the 
extremely  poor  quality  of  observations  of  DMA.  The  behavior  of  the  team  when  Cp2  is 
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varied  in  the  same  manner  is  similar  to  the  above  case.  The  results  appear  in  Figure  9b. 
By  comparing  the  two  plots,  we  see  once  again  that  the  smarter  DM  should  be  placed 
downstream. 


6.2  Comparison  of  Performance 

Using  the  plot  of  Pr(E)  vs.  P(Hq)  it  is  possible  to  compare  the  performance  of  the 
isolation,  two-message,  three-message,  four-message  and  centralized  cases.  The  goal  is  to 
see  the  effect  increasing  communication  has  on  the  team  performance.  In  Figure  10  we 
have  presented  all  the  cases  plotted  together  for  the  sake  of  comparison.  It  can  be  seen  that 
with  the  increase  in  information,  the  performance  of  the  team  approaches  that  of  the 
centralized  version  of  the  problem,  which  corresponds  to  an  infinite  number  of  messages. 
The  improvement  expressed  as  a  percentage  is  as  follows  : 

Isolation  to  the  Two-message  Case  :  17% 

Two-message  to  the  Three-message  Case  :  4% 

Three-message  to  the  Four-message  Case  :  1.4% 

Four-message  to  the  Centralized  Case  :  1.8% 

Hence,  there  is  a  significant  improvement  in  performance  when  the  team  members 
communicate  as  opposed  to  being  in  isolation.  However,  there  is  no  point  in  using  more 
than  a  few  bits  of  information  to  communicate  from  DMA  to  DMB  since  there  is  not  much 
room  for  improvement  (only  1.8%).  It  can  also  be  shown  that  decision  makers  operating 
as  a  team  acknowledge  their  team  member's  capability  and  make  decisions  that  benefit  the 
team.  We  compute  the  Pr(E)  for  three  different  scenarios  to  prove  this. 
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(i)  A  decision  maker  in  isolation  with  cDM2  =  100. 


Pr(E)  =  0.18615 

(ii)  DMA  and  DMB  operating  as  a  team  with  DMA  using  three  messages  (K=3)  to 
communicate  with  DMB.  In  this  case,  oa2  =  20,000  and  o^2  =  100. 

Pr(E)  =  0.18605 

(iii)  The  centralized  version  of  the  problem  where  DMA  passes  on  his  entire 
observation  to  DMB.  Once  again,  cQ2  =  20,000  and  o^2  =  100. 

Pr(E)  =  0.18602 

Thus,  we  see  that  the  performance  of  the  three  cases  are  comparable.  Comparing  (i) 
and  (ii),  we  see  that  DMB  does  not  consider  DMA's  information  as  being  of  any  value 
when  the  quality  of  DMA's  observation  is  poor.  Hence,  DMB  acts  as  though  it  were  in 
isolation.  Comparing  (ii)  and  (iii),  we  conclude  that  if  DMA's  observations  are  of  poor 
quality,  the  amount  of  communication  capability  given  to  DMA  does  not  matter  since  DMB 
is  going  to  ignore  his  observation  anyway. 

Finally,  we  compare  the  Pr(E)  for  two  different  scenarios  to  see  the  effect  of  increasing 
communication. 

(i)  The  decision  makers  operating  as  a  team,  with  DMA  being  the  smarter  one.  The 
two- message,  three-message  and  centralized  cases  are  considered  for  comparison. 
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(ii)  The  decision  makers  operating  as  a  team,  with  DMB  being  the  smarter  one.  Again, 
the  two-message,  three-message  and  centralized  cases  are  considered  for 
comparison. 

From  Figure  1 1 ,  we  conclude  that  the  improvement  in  performance  from  the  two- 
message  to  the  three-message  case  is  greater  if  DMA  is  the  smarter  decision  maker.  Hence, 
we  show  again  that  there  is  no  point  in  giving  more  communication  capability  to  a  decision 
maker  who  is  not  smart. 


6.3  Threshold  Analysis 

Here  we  study  the  thresholds  of  the  decision  makers  for  the  three-message  case  as  we 
vary  oa2,  Op2  and  P(H0).  The  thresholds  of  the  decision  makers  is  another  way  of 
representing  probabilities  of  decision  makers'  decisions  since  decision  regions  are 
characterized  by  thresholds.  Thus,  performing  a  threshold  analysis  proves  to  be  very 
informative. 

Effects  of  varying  a2  on  the  thresholds  of  the  DM's  : 
a 

In  Figure  12,  the  quality  of  DMA's  observations  (i.e.,  aQ2)  has  been  varied  to  study 
the  behavior  of  DMA's  thresholds.  Figure  11a  shows  the  symmetric  behavior  of  the 
thresholds  for  the  case  when  P(Ho)  =  0.5.  We  can  see  in  Figure  1  lb  (when  P(Ho)  =  0.8) 
that  DMA  tends  to  be  biased  towards  the  more  likely  hypothesis  as  oa2  increases. 

In  Figure  13,  we  vary  the  quality  of  observations  of  DMA  (i.e.,  Ca2)  to  study  the 
behavior  of  DMB's  thresholds.  Again,  there  is  symmetry  in  the  case  where  P(H0)  =  0.5. 


68 


The  threshold,  YgM2  (when  DMA  declares  M^,  coincides  with  the  maximum  likelihood 
threshold  of  DMB  since  DMA  is  not  giving  any  indication  regarding  the  absence  or 
presence  of  a  target  to  DMB.  For  both  cases  (P(Hq)  =  0.5  and  P(Hq)  =  0.8),  as  cra2 
increases,  all  the  thresholds  approach  the  maximum  likelihood  threshold  of  DMB.  This  is 
due  to  the  fact  that  the  quality  of  information  from  DMA  is  very  poor  and  DMB  tends  to 
give  it  less  importance.  Thus,  DMB  uses  logic  and  intuition  in  making  his  decision. 

Effects  of  varying  <r2  on  the  thresholds  of  the  DM's : 

In  Figure  14,  the  quality  of  DMB's  observations  (i.e.,  (Jg2)  has  been  varied  to  study  the 
behavior  of  DMA's  thresholds.  Figure  14a  shows  symmetry  due  to  the  chosen  value  of 
P(H0)  =  0.5.  In  Figure  14b,  we  see  that  DMA  tends  to  declare  Mj  more  often  than  in  14a 
since  the  a  priori  probability  of  the  target  being  absent  is  greater  (i.e.,  P(Ho)  =  0.8).  For 
both  cases  (P(Ho)  =  0.5  and  P(Hq)  =  0.8),  as  Og2  increases,  DMA  tends  to  be  more 
decisive  (by  declaring  M!  or  M3)  and  gives  a  more  definitive  message  since  he  knows 
DMB's  quality  of  information  is  poor.  Hence,  the  lower  and  upper  thresholds  of  DMA 
tend  to  converge  together  for  high  Og2.  In  Figure  14b,  we  see  that  DMA  decides  not  to  rely 
on  DMB's  observations  after  Cg2  =  1000  and  hence  the  thresholds  converge  rather  rapidly 
after  this  point.  We  conclude  that  DMA  is  demonstrating  team  behavior  by  acknowledging 
the  capability  of  DMB. 

In  Figure  15,  we  vary  the  quality  of  observations  of  DMB  (i.e.,  Og2)  to  study  the 
behavior  of  DMB's  thresholds.  Again,  in  Figure  15a  we  see  the  symmetry  due  to  the 
chosen  value  of  P(Ho)  =  0.5.  We  can  see  the  bias  of  DMB  towards  declaring  the  absence 
of  the  target  since  P(H0)  =  0.8  in  Figure  15b.  It  is  evident  that,  for  high  Cg2,  DMB  is 
biased  towards  what  DMA  declared  since  its  own  observation  is  of  poor  quality.  We 
conclude  that  DMB  acts  in  the  best  interest  of  the  team. 
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Effects  of  varying  P(H0)  on  the  thresholds  of  the  DM's  : 


In  Figure  16,  the  a  priori  probability  of  the  hypothesis  Hq,  P(Ho),  has  been  varied  to 
study  the  behavior  of  the  thresholds  of  the  decision  makers.  There  is  symmetry  in  the 
behavior  of  the  thresholds  for  DMA  and  DMB  about  P(Ho)  =  0.5.  From  Figure  16a,  we 
see  that  DMA  favors  declaring  M2  around  P(Ho)  =  0.5.  Towards  the  extreme  values  of 
P(Ho)  (both  low  and  high  values),  DMA  tends  to  be  more  decisive.  In  other  words,  for 
low  values  of  P(Ho)  DMA  is  biased  towards  declaring  M3  and  for  high  values  of  P(Hq) 
DMA  is  biased  towards  declaring  Mj.  In  Figure  16b,  the  point  X  represents  the  threshold 
when  P(Ho)  =  0.5  and  DMA  declares  M2.  The  point  X  also  represents  the  maximum 
likelihood  threshold  for  P(Hq)  =  0.5.  This  makes  intuitive  sense  and  is  not  surprising.  The 
point  Y,  in  Figure  16b,  shows  how  the  decision  makers  operate  as  a  team  rather  than  in 
isolation.  If  DMB  were  in  isolation,  point  Y  is  associated  with  a  target  being  present. 
However,  if  DMA  were  to  declare  Mj  in  a  team  setting,  DMB  would  declare  the  absence  of 
a  target  given  point  Y. 


6*1  Summary 

The  following  observations  summarize  the  results  of  the  numerical  studies. 

(i)  For  optimum  performance,  it  was  found  that  the  smarter  decision  maker  should  be 
placed  downstream. 

(ii)  We  realized  that  there  was  no  point  in  increasing  the  communication  capacity  of  a 
dumb  decision  maker  (i.e.,  DMA  in  our  case). 


75 


P(H0) 


(a)  DMA  Thresholds  (ca2  =  o^2  =100) 


P(H0) 


(b)  DMB  Thresholds  (aa2  =  op2  =  100) 


Figure  16  Thresholds  of  DMA  and  DMB  vs.  P(Ho)  (K  =  3) 
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(iii)  The  benefits  of  the  team  structure  are  best  seen  around  P(Ho)  =  0.5  (i.eM  where 
the  prior  uncertainty  is  the  greatest). 

(iv)  It  was  found  that  the  decision  makers  of  a  team  make  decisions  that  are  in  total 
contrast  of  their  decisions  that  they  would  make  if  placed  in  isolation.  In  other 
words,  they  operate  as  a  team  and  make  decisions  that  benefit  the  team. 
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Chapter  7 


CONCLUSIONS  AND  SUGGESTIONS  FOR 
FUTURE  RESEARCH 


This  chapter  contains  the  conclusions  of  this  research  and  suggestions  for  future 
research. 

7.1  Conclusions 

A  distributed  detection  problem,  one  of  the  simplest  forms  of  decentralized  decision 
making,  has  been  studied.  The  detection  team  consists  of  two  decision  makers,  DMA  and 
DMB,  each  receiving  an  observation.  There  is  a  one-way  communication  between  the 
decision  makers  (from  DMA  to  DMB).  The  goal  of  the  team  is  to  make  a  decision 
regarding  the  presence  or  absence  of  a  target,  while  trying  to  minimize  the  probability  of 
error  (i.e.,  minimizing  the  cost  function,  which  depends  on  the  team  decision  and  the  true 
hypothesis). 

We  extended  the  two-message  case,  where  DMA  uses  two-messages,  Mi  and  M2,  to 
communicate  with  DMB,  to  one  where  three-messages,  Mj,  M2  and  M3,  are  used  by  DMA 
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for  communication.  We  showed  that  by  invoking  the  conditional  independence  assumption 
the  optimal  decision  rules  of  both  decision  makers  are  given  by  deterministic  functions, 
expressed  as  likelihood  ratio  tests  with  constant  thresholds.  The  optimum  decision 
thresholds  of  the  two  decision  makers  for  the  three-message  case  are  coupled  and  cannot  be 
expressed  in  closed  form.  In  the  linear  Gaussian  case  the  optimal  decision  rules  reduce  to 
threshold  tests  on  the  observation  axes.  We  studied  the  improvement  in  performance 
achieved  by  increasing  the  communication  capacity  of  DMA  by  half  a  bit.  Furthermore,  the 
Gaussian  example  was  used  to  perform  sensitivity  studies  to  enhance  our  knowledge  of 
team  behavior. 

We  concluded  that  in  order  to  optimize  performance,  the  smarter  DM  (if  there  exists 
one)  should  be  placed  downstream.  This  result  was  expected  since  the  downstream 
decision  maker  makes  the  final  decision  of  the  team.  In  addition,  we  found  that  there  was 
no  point  in  increasing  the  communication  capability  of  a  "dumb"  decision  maker. 
Regardless  of  the  communication  capability  of  DMA,  DMB  is  going  to  give  less  importance 
to  his  message  knowing  DMA's  observation  is  of  poor  quality. 

Through  the  sensitivity  analysis  we  learnt  that  the  benefits  of  the  team  structure  are  best 
seen  around  P(Hq)  =  0.5.  This  is  not  surprising  since  in  an  isolated  setting  a  decision 
maker  is  most  uncertain  at  P(Hq)  =  0.5,  and  communication  between  decision  makers  of  a 
team  would  be  very  helpful.  It  was  also  found  that  decision  makers  operate  as  a  team  and 
make  decisions  that  benefit  the  team.  For  instance,  a  team  member  makes  decisions  which 
are  in  total  contrast  with  the  decision  he  would  make  if  he  were  in  isolation  and  not  a 
member  of  the  team. 

Finally,  the  number  of  messages  used  by  DMA  to  communicate  with  DMB  is  increased 
beyond  three.  The  Four-message  Case  is  solved  and  its  performance  is  evaluated.  In 
addition,  the  General  K  Case  is  solved  and  the  threshold  equations  have  been  presented. 
The  goal  was  to  see  how  quickly  increasing  communication  between  the  team  members  in 
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this  manner  results  in  the  performance  of  the  team  approaching  that  of  the  centralized 
version  of  the  problem  (a  single  decision  maker  receiving  two  observations).  We  conclude 
that  on  the  basis  of  these  numerical  studies,  there  is  not  much  potential  for  improvement  in 
performance  beyond  the  use  of  two  bits. 

7.2  Suggestions  for  Future  Research 

Using  the  same  team  structure,  it  would  be  interesting  to  assign  a  cost  to  each  of  the 
messages  used  by  DMA  (i.e.,  using  four  messages  would  be  more  expensive  than  using 
three  messages)  and  find  an  optimum  point  (i.e.,  number  of  messages)  without  sacrificing 
the  performance  of  the  team.  In  other  words,  the  cost  and  the  performance  of  the  team 
would  have  to  be  chosen  optimally. 

Another  extension  would  be  to  consider  the  problem  where  the  observations  that  the 
decision  makers  receive  are  n-dimensional,  or  rather,  more  complex  vector-valued 
quantities  (as  opposed  to  mere  scalars  such  as  ya  and  yp).  It  would  be  interesting  to  see 
what  implications  this  has  on  the  structure  of  the  decision  rules  of  the  members  of  a 
detection  team.  This  generalization  results  in  a  more  realistic  problem  and  will  prove  to  be 
a  building  block  for  more  complex  organizations. 
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Appendix 


The  detailed  proofs  of  the  various  theorems  and  corollaries  are  presented  in  this 
appendix. 

Proof  of  Theorem  3  : 


The  objective  is  to  minimize  the  expected  value  of  the  cost  function  which  can  explicitly 
be  written  as 


E<J(U(S,  H))  =  X  f  P<V  V  H'  V  V  J(V  10  dyadyB 
vv"  V, 

-  X  j  P%  1  “o’  »•  V  V  P<V  V  yB  1  pw  J<7  H>  dy„dy( 


V  VH  V  V 

°  p  vy| 


Invoking  the  appropriate  independence  assumptions  (Assumption  2)  yields 
-  X  j  p%  1  v  V  p< V  1  H>  I  H)  P(H)  J(V  H)  dyady( 


“  «  “o'  H  y  v 

“  P  ”a’  yp 


Substituting  P(up  =  1 1  ua,  yp)  =  1  -  P(up  =  0  i  ua,  yp)  and  ignoring  the  constant  term 


yields 


= X  J  p%=  0 1 V  V  P(V  ya 1  H)  P(yp 1  ^  P(H)  [  J(0’  H)  -  H>  ]  dyadyp 


«*  vy& 


=X  J  p<up=  0  1  V  yp>X  J  p(ua>  ya  I  H)  P(yp  I  H)  P(H)  f  J(0,  H)  -  J(l,  H)  ]  dyQdyp 
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To  minimize  the  expression  on  the  previous  page,  let 


P(up  =  0  I  ua,  yp) 


j  0  if  "INNERSUM"  >  0 
l  1  otherwise 


where 


"INNERSUM"  =  X  f  P(u  ,  y  !  H)  P(y.  I  H)  P(H)  [  J(0,  H)  -  J(l,  H)  ]  dy 

~  Jaap  a 

H 

The  above  expression  can  be  written  as 


=  J  XP(U  IH)P(y  lH)P(H)[J(O.H)-J(l,H)]dyo 
y  H 

J  a 

Expanding  the  integrand  (which  must  be  negative)  over  H  and  invoking  Assumption  1 
yields 

P(u  I  H0)  P(y  I  H0)  P(H0)  [  J(l,  H0)  -  J(0,  HJ  ] 

Ct  p 

T°  P(ua  I  Hj)  P(yp  I  Hj)  PCHj)  [  J(0,  Hj)  -  J(l,  Hj)  ] 


Rearranging  terms  we  get 


P(yBIH0)  “g=0  P(Hj)  P(U^  I  Hj)  [  J(0,  Hj)  -  J(l,  Hj)  ] 

P(yp  I H,)  P(H0)  P(u“  I  [  J(l,  H0)  -  J(0,  H0)  ]  (92) 

where  the  quantity  on  the  right  hand  side  of  the  inequality  is  referred  to  as  P1  when 
ua  =  i  for  i  =  Mi,  M2  and  M3. 

This  is  the  optimal  decision  rule  for  DMB  appearing  in  Theorem  3. 
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Lemma  1 : 


If  the  optimal  decision  rule  presented  in  Theorem  4  is  employed  for  ua,  then,  whenever 
the  following  conditional  probabilities  are  defined,  we  have 

P(up=  0  I  ua=  Mp  H0)  ;>  P(Uf  =  0  I  uq=  M2,  Hq)  >  P(up=  0  I  ua=  M3,  HQ) 

Proof : 

Using  Assumption  3  and  the  thresholds  derived  in  Theorem  3  we  find 
Pm!  s  Pm2  -  Pm3 

From  Theorem  3  we  get  the  equality  that  appears  below. 

P(up  =  0  I  ua  =  i,  Hq)  =  f  2  P(H)  P(yR  1  ^  (94) 

VV*P‘  “ 

Since  P(H)  P(yp  I H)  is  always  positive,  (97)  and  (98)  yield 

P(up=  0  I  ua=  Mv  Hq)  2:  P(up=  0  I  uq=  M2,  Hq)  >  P(up=  0  I  ua=  M3,  HQ) 

This  corollary  has  been  used  in  the  proof  of  Lemma  2. 
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Lemma  2 : 


If  the  optimal  decision  rule,  derived  in  Theorem  4,  is  employed  for  ua,  then,  when  the 
following  conditional  probabilities  are  defined,  we  have 

X  J%.HQ)[P(upluti=M1,H0)-P(upluo=M21H0)]  <  0 
X  «u  ,H0)[P(uplu(i=M1,H0)-P(Upluo=M3,H0)]  S  0 

% 

Proof : 

Only  the  following  equation  will  be  proved  since  the  proofs  of  each  of  the  three 
equations  appearing  above  is  similar. 

X  ,(ly  H0)  [  P(“b  1 V  Mr  H0>  -  P(“6 1 V  M3  '  Ho>  ]  *  0 

Expanding  the  above  we  get 

J(0,  H0)  P(up=  0  I  u  =  Mr  H0)  +  J(l,  H0)  P(up=  1  I  ua=  Mj, 

-  J(0,  H0)  P(up=  0  I  ua=  M3,  Hq)  -  J(l,  H0)  P(u  =  1  I  ua=  M3,  Hq) 

Substituting  P(up  =  1  I  ua  =  i,  H0)  =  1  -  P(up  =  0  I  ua  =  i,  H0)  for  i  =  Mj,  M3  and 
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combining  terms  yields 


[  P(Uf  =  0  I  uq=  Mj,  H0)  -  P(up=  0  I  uq=  M3,  H0)  ]  [  J(0,  H0)  -  J(l,  HQ)  ] 

Using  Lemma  1  and  Assumption  1  we  see  that  the  above  expression  is  less  than  or 
equal  to  zero. 


Proof  of  Theorem  4  : 

Once  again,  the  objective  is  to  minimize  the  expected  value  of  the  cost  function  which 
can  explicitly  be  written  as 


E{J(up,  H)}  =  2  |  P(ua'  V  H’  ya’  V  J(up’  ^  dyadyp 

u  ,  u  ,  H  v  v 
a  P  ya’  yp 

=  X  f  P(ur  1 V  H’  y«’  it)  P(l W  yR 1  P(H)  J(V  dy„dyR 

'  jpaapaap  P  ap 

WH  ya- 

Invoking  the  appropriate  independence  assumptions  (Assumption  2)  yields 


=  X  J  P(UP  1  "a'  V  P(Ua-  yo  '  H)  P(yB  '  10  P<H)  '(V  H>  dyo% 

vv" 

-  y  f  P<u.  I  u  y  )  P(u  I  v)  P(y  1  H)  P(y„  I  H)  P(H)  J(u  H)  dy  dy„ 

„  J  pap  a  a  a  P  P  a  p 

u„.  u„.  H  y  y 

0  P  “a*  yp 
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Explicitly  summing  over  ua  and  integrating  over  yp  yields 


f  P(u  =  M.  I  y  )  Y  P(u  I  u  =M  H)P(y  I  H)  P(H)  J(u  ,  H) 

J  a  1  a  pa1  a  p 

1/  ua,H 


+  P(ua=  M2 1  ya)  £  P(u  I  ua=  My  H)  P(ya  I  H)  P(H)  J(u  H) 


u..  H 


+  P(U  =  M3  I  ya)  X  P(UB  1  V  M3’  h>  p(ya  1  H)  P(H)  J(V 


ua,H 


dya 


Now  set 


pi  =  Y  P(uR  I  u  =  i,  H)  P(y  I  H)  P(H)  J(u  H) 

p  a  a  p 


vH 


To  minimize  the  cost  we  use 


P(u  =  i  I  y  )  = 
a  a 


i  M,  M,  M, 

1  if  P  =  min  {  P  ,P  ,P  } 

0  otherwise 


Hence,  the  optimal  decision  rule  takes  the  form 


ua  =  Ya(ya)  =  i  if  P(ua  =  i  1  ya)  =  1  for  i  =  Mj,  M2,  M3 


Finally,  invoking  Assumption  1,  it  is  a  matter  cf  simple,  but  tedious  algebraic 
manipulations  to  put  the  decision  rule  in  the  following  form 


M.  ,  if  A  (y  )  >  a  and  A  (y  )  >  a 
1  a  a  1  a  a  2 

Ya^Ya)  -  ^  M, ,  if  A  (y  )  <  a  and  A  (y  )  >  a 

z  a  a  1  a  a  3 

l  Ma  ,  if  A  (y  )  <  a  and  A  (y  )  <  a 
1  a  a  2  a  a  3 
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where 


X  J(iy  Hj)  [  P(up  I  ua=  M2,  Hj)  -  P(UjJ  I  uq=  Mv  H,)  ] 
aj  =  -A -  (95) 

X  J<v  H0>  [  p(up 1  ua=  M1-  Ho>  -  p(up 1 V  m2>  ho>  ] 

X  J<V  Hi)  t  p% 1  v  ^  H1)  -  P(up  1 V  M1’  «!> 1 

a2  =  A -  (96) 

X  J<V  H0>  [  P<Up  1  Ua=  Ml’  Ho)  -  P%  '  V  “3*  H0}  1 

X  «V  Hi)  t  P(up  I  ua=  M3,  -  P(Up  I  ua=  Mj.  Hj)  ] 

a  =  A -  (97) 

X  J%’  Ho)  I  P%  1 V  M2’  Ho)  *  p(up 1 V  Ho>  1 


For  example,  to  arrive  at  the  conditions  for  DMA  to  declare  Mj  we  need  both  (i)  and  (ii) 
below  to  be  satisfied. 


(i)  PMi  <  Pm2  (ii)  PM1  <  Pm3 


(i)  PMi  <  Pm2  can  be  written  as 


X  P(u« 1  u  =  Mr  H>  p<y  1  H)  pW  «) 

-*■7,  Pa*  a  p 


<  X  PK  1  u  =  My  H)  P(y  I  H)  P(H)  J(u,  H) 

.TTi  p  a  1  a  p 
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Expanding  we  get 


X  P% 1 V  Mr  Ho)  p(ya  1  Ho>  POV  J(up.  Ho) 


+  X  PCU„  1 V  Mr  Hi}  P(ya  1  Hi)  P(Hi)  J(up’  Hi} 

“p 

<  X  P<UP  1  v  M2*  Ho>  p(ya  1  Ho)  p(H0)  J(up,  Ho) 
+  X  p<up  1  V  Hl}  P(ya  1  Hl}  P(Hl)  J(up*  H1} 

“p 


Finally,  rearranging  the  terms 


p(H0)  P(ya  I H0) 
POHj)  P(yaIH1) 


> 


X  J<Up’  Hl>  t  P%  1  V  M2’  Hl}  *  P(Up  1  V  Ml’  Hl>  ] 

J!b _ 

X  J<Up’  H0>  [  P%  1  V  Ml’  H0>  '  P%  '  V  M2’  H0>  1 

“P 


or 


W  5  “i 


(ii)  PMi  <  Pm3  can  be  written  as 


y  P(uft  I U  =  M.,  H)  P(y  I  H)  P(H)  J(u  ,  H) 

p  a  ‘  a  P 

vH 

<  y  P(uft  I  u  =  WL ,  H)  P(y  I  H)  P(H)  J(u  ,  H) 
P  a  J  ■'a  P 
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Similarly,  expanding  and  rearranging  the  terms  we  get 


P(Hq)  P(ya  I  Hjj)  ^ 

P(H  )  P(y  I  H.)  " 

1  a  1 


X  J«y  H,)  l  P(u@  I  v  M,  .  H,)  ■  P(u  I  v  M,,  H,)  ] 

Ji _ 

X  JOy  Ho)  [  P(u  I  v  M,,  H„)  -  P(Up  I  u-  M3  ,  H„>  ] 


or 


A  (y  )  >  a2 
a  a  * 


We  have  used  Lemma  2  to  write  the  inequalities  in  the  manner  that  they  appear  above. 
Similarly,  the  conditions  for  DMA  declaring  M2  and  M3  can  be  derived. 

Finally,  it  is  easy  to  show  that  is  redundant  in  the  above  decision  rule  by  proving 
that  <  ttj  and  >  o^.  We  will  show  the  proof  for  otj  <  ctj  only,  since  the  proof  for 
otj  >  ttj  is  very  similar. 

Writing  out  the  expressions  for  otj  and  o ^  we  find  that  we  have  to  show 

X  J<v  H>> [  P(V  v  Mr  h.>  -  v  Mp  H>> 1 

JJb _ 

X  J<V  Ho>  t  P<V  V  Mr  “o'  -  P<V  v  Mr  H0>  I 

“p 

X  *V  H,>  I  p<u.  1 V  M3'  HiJ  ‘  P(u|> 1 V  Mr  Hi>  1 

>  3 - 

X  J<V  Ho>  I  p%  1 V  Mr  Ho>  •  P(u8 1 V  M3*  ho>  ) 

y 
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Expanding  and  cross-multiplying  we  get 
{  J(0,  Ht)  [  P(up=  0  I  uq=  M^  Hj)  -  P(up=  0  I  uo=  Mj,  Hj)  ] 

+  J(l,  Hj)  [  P(up=  1  I  ua=  ^  Hj)  -  P(up=  1  I  uq=  Mr  Hj)  ]  } 

{  J(0,  H0)  [  P(up=  0  I  uq=  Mv  H0)  -  P(up=  0  I  ua=  Mj,  HQ)  ] 

+  J(l,  H0)  [  P(up=l  I  ua=  Mj,  H0)  -  P(up=  1  I  ua=  M2,  Hj,)  ]  ) 

> 

{  J(0,  Hj)  t  P(U  «  0  I  Ua=  M3  ,  Hj)  -  Pfo  =  0  I  U  =  Mj,  Hj)  ] 

+  J(l,  Hj)  [  P(U{  =  1  I  ua=  M3  ,  Hj)  -  P(Uf  =  1  I  ua=  Mj,  Hj)  ]  } 

{  J(0,  H0)  [  P(up=  0  I  ua=  Mj,  H0)  -  P (Uj  =  0  I  ua=  M3  ,  Ho)  ] 

+  J(l,  H0)  [  P(up=l  I  ua=  Mj,  H0)  -  P(up=  1  I  ua=  M3  ,  H0)  ]  } 

Once  again,  expanding,  combining  terms  and  writing  the  inequality  with  respect  to  zero 
we  write 

J(0,  Hj)  J(0,  H0)  [  P(up=  0  I  uq=  M2,  Hj)  P(up=  0  I  Ua=  M,,  HQ) 

-  p<  v 0 1  v  M,  • «,)  p<  v 0 1  v  •  Ho> 

+  P(u9=  0  I  Uo=  M, ,  Hj)  P(uf=  0  I  u«  M3,  H0) 

-  P(u9=  0 1  V  M3  ’  HI>  P(Uff  0  1 V  M> '  Ho> 

+  P(u?=  0 1  Qo=  Mj ,  H,)  P(u I  »  0  I  Uo=  M2 ,  H,,) 

-P(up=OIVM1,H,)P(U|  =  0|VM2,H„)] 
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+  J(0,  Hj)  J(l,  HJ  [  P(up=  0  I  ua=  M2,  Hj)  P(up=  1  I  ua=  Mj,  HQ) 
-P(up=0'ua=M31H1)  P(up=  1  I  ua=  Mj  ,  Hq) 

+  P(Up=  0  ‘  V  M1  ’  Hl>  P^Up=  1  1  V  M3’  «o) 

-  P<V  0  1  V  ^  ’  Hl}  P(Ur  llUa=M3  ’  H0> 

+  P(up=  o  I  ua=  M3  ,  P(up=  1  I  ua=  M, ,  H0) 

-  P(up=  0 1  ua=  Mj  ,  Hj)  P(up=  1  I  ua=  M2  ,  H^  ] 

+  J(l,  Hj)  J(0,  HJ  [  P(up=  1  I  u  =  M2,  Hj)  P(up=  0  I  ua=  Mj,  H0) 

-  P(up=  1 1 u-  M,  ,  Hj)  P(up=  0  i  u-  M3  ,  H0) 

+  P(up=  1  1  ua=  Mj  ,  Hj)  P(up=  0  I  ua=  M3  ,  H0) 
*P(Up=Hua=M3  ,Hj)P(up=Olua=Mj  ,H0) 

+  P(up=  1  I  ua=  Mj  ,  Hj)  P(up=  0  I  ua=  Mj  ,  H0) 

-  P(up=  1  I  u  =  Mj  ,  Hj)  P(up=  0  I  Uq=  M2  ,  HJ  ] 

+  J(l,  Hj)  J(l,  HJ  [  P(up=  1 1  ua=  M2,  Hj)  P(up=  1  I  u»  Mj,  HJ 

'  P(up=  1 1  ua=  M2  .  Hj)  P(up=  1  1  ua=  Mj  ,H0) 

+  P%=  1  I  V  M1  ’  Hl)  P(Uf  1  1  V  M3  ’  H0> 

-  p(up=  1  I  V  Mj  ,  Hj)  P(up=llua=Mj,H0) 

+  P(up=  1  I  ua=  Mj  ,  Hj)  P(up=  1  I  ua=  M2 ,  H0) 
-P(up=llua=Mj,Hj)P(up=llua=M2,H0)]  >  0 
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We  can  see  that  the  above  inequality  holds  by  looking  at  adjacent  terms  and  using 
Lemma  1. 

Finally,  we  can  put  the  decision  rule  in  the  form  that  appears  in  Theorem  4. 

Proof  of  Corollary  3  : 

There  are  three  esses  to  be  derived  for  the  decision  rule  of  DMB. 


(i)  DMA  declares  (i.e.,  ua  =  : 

P(yR  I H0)  ug=0  P^)  P(u  =  Mj  I  Hj)  [  J(0,  Hj)  -  J(l,  Hj)  ] 

P(yp  I “  P(H0)  P(ua=  Mj  I  [  J(l,  HQ)  -  J(0,  HQ)  ] 

Substituting  the  Gaussian  probability  density  functions  and  using  the  minimum  error 
cost  function  (i.e.,  J(0,  Ho)  =  J(l,  Ht)  =  0  and  J(0,  Hj)  =  J(l,  H0)  =  1)  we  have 


P(Hj)  P(U<i=  Mj  I H,) 
P(Hq)  P(u°=  I  HQ) 


Taking  natural  logarithms  on  both  sides  we  get 


> 


'  P^MjIHj)]  \  1  -  P(HQ) 

P(u”=  Mj  I  Hq)  +  ln[  P(H0) 
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Finally,  multiplying  both  sides  of  the  equation  by  2<jp2, using  the  definition  of  the  error 
function  and  isolating  yp  we  get 


y°  <  ,  'V'"  <n  rvrv  \in  +  »' 

y  k  — -2 —  In  j  +  - 2 —  in  — pr/jT  +  -2-r — - 

P  u  -a  0  (1)  u  -u  l-p(Ho)  2 


O1  (0) 


P(HJ 


y  TV1 
yV  P 


(ii)  DMA  declares  M2  (i.e.,  ua  =  M2) : 


p(yfl  I  H0)  ug=o  P(Hj)  P(ua=  M2  I  Hj)  [  J(0,  Hj)  -  J(l,  Hj)  ] 
P(yp  I  Hj)  "  P(H0)  P(ua=  M2  I  H0)  [  J(l,  H0)  -  J(0,  HQ)  ] 


Similarly,  using  the  Gaussian  probability  density  functions,  the  minimum  error  cost 
function,  taking  the  natural  logarithm  on  both  sides,  substituting  the  error  functions  and 
isolating  yp  we  get 


yo  <  r  pfH»>  n0+ 

y a  —  - “ —  In  i  +  ® —  In  1  D/'u  \  +  — ^-z- 

4l"^0  L  0a(1)*°a(1)J  ^"^0  L  °  J  2 


y  TV2 
^P  P 
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(iii)  DMA  declares  M3  (i.e.,  ua  =  M3) : 


P(yft  I H0)  Ufi=o  PCHj)  P(ua=  M3  I  Hj)  [  J(0,  Hj)  -  J(l,  Hj)  ] 

P(yp  I  Hj)  P(H0)  P(ua=  M3  I  H0)  [  J(l,  H0)  -  J(0,  HQ)  ] 

Similarly,  using  the  Gaussian  probability  density  functions,  the  minimum  error  cost 
function,  taking  the  natural  logarithm  on  both  sides,  substituting  the  error  functions  and 
isolating  yp  we  get 


UB=° 

p'  B  i« 

1  -Ou(0) 
a 

°B 

»  D  1  — 

r  p(H0)  ' 

y  £  - H —  In 

P  [i  -  LL 

i - 

0k 

> — ✓ 

i - K —  in 

Vr** 

1  -  P(H0) 

M-  +M- 


1 


or 


y 


p 


This  completes  the  proof  of  Corollary  3. 


Proof  of  Corollary  4  : 


This  corollary  can  be  proved  by  considering  the  cases  when  DMA  declares  Mj  and 
when  DMA  declares  M3. 

When  DMA  declares  Mj  we  have 


p(yJ  Ho> 

P(ya  I H,) 


P(Hj)  X  Hi>  [  p(uplua=M2’  Hi> '  P(up'V  Mr  Ht>  ] 

“b _ 1 _ 

p(Ho)  X  J<V  Ho)  t  p(up'V  Mr  Hq)  *  p(Up'ua=  M2,  H0)  ] 
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Expanding  the  right  hand  side  of  the  above  equation  we  have 


P(Hj)  {  J(0,  Hj)  [  P(up=  0  I  uq=  M,,  Hj)  -  P(up=  0  I  uq=  Mv  Hj)  ] 
+  J(l,  Hj)  [  ?{u  =  1  I  uq=  Hj,  Hj)  -  P(up=  1 1  ua=  Mj,  Hj)  ]  } 


P(H0)  {  J(0,  [  P(up=  0  I  ua=  Mr  H0)  -  P(up=  0  I  Ua=  M2,  ] 

+  J(l,  Hfl)  [  P(up=l  I  ua=  Mj,  H0)  -  P(up=  1  !  u  =  M2,  Hq)  ]  } 


Substituting  error  functions  we  get 


J(0,  Ht)  [  0^2(1)  -  0^(1)  ]  4-  J(l,  Ht)  [  (1  -  0^2(1))  -  (1  -  0^(1))  ] 
J(0,  Hfl)  [  o“‘(0)  -  Op  2(0)  ]  +  J(l,  H0)  [  (1  -  0^(0))  -  (1  -  Op  2(0))  ] 


Simplifying 


Hj)  -  J(l,  Hj)  3 
(O^2(0)  -  Op '(0))  [  J(l,  H0)  -  J(0,  H0)  ] 


Now,  considering  the  original  inequality,  we  substitute  the  Gaussian  probability 
density  function,  use  the  minimum  error  cost  function  (i.e.,  J(0,  Hq)  =  J(l,  Hj)  =  0  and 
J(0,  Hj)  =  J(l,  Hq)  =  1)  and  take  natural  logarithms  on  both  sides  to  get 


2y  jo.  -  u2  -  2y  u  +  u2 
Q  Iflll  *1 

2o2 

a 


u  =M, 


In 


M,  M, 

<V  q)-<V(i) 


M,  M, 

<*>  (°)-^o  (°) 

P  P 


1  -  P(H0) 

“W 
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Isolating  ya  we  get 


« 


• 

u  =M,  G2 

M,  M.  ' 

<V(0) 

o2 

i  cx 

r  p(Ho)  ‘ 

y  ^  a —  In 

°  p.  -  p. 

M,  M, 

<bp2(  1) -Op‘(l) 

H - 54 —  in 

1  -  P(H0) 

Li  +  (I 
+  3 _ LL 


or 


u  =M 


a 


When  DMA  declares  M3  we  have 


p(y'H<>)  Vm3 

_st — < 


P(Hj)  £  J(u  H,)  [  P(u  lua=M3  ,  Hj)  -  P(u  lua=  M2 ,  Hj)  ] 


A. 


P(y“ 1  Hl>  PdV  X  J< V  H„)  [  P(U  I V  Mj ,  H„)  -  P(u  I V  M, ,  fV  ] 


Similarly,  expanding  the  right  hand  side,  substituting  error  functions,  simplifying, 
substituting  the  Gaussian  probability  density  function,  using  the  minimum  error  cost 
function,  taking  natural  logarithms  on  both  sides  and  isolating  ya  we  arrive  at  the  inequality 
that  appears  below. 


u  =m3  a2 

r  M,  M,  " 

\  (°)-°6  (0) 

O2 

j_  (X 

[  p(Ho)  ' 

y  >  - 54 -  in 

a  u  -  u 

3  3 

M,  M, 

O  3(1)  - <X>  2(1) 
L  p  p 

h - - —  in 

1  -P(H0) 

u  +  Ll 

3 _ LL 


or 


u  =M, 
a  3 


> 


Y” 
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Now,  to  write  the  conditions  when  DMA  declares  M2  we  need  to  show  that  Ya!  <  Yau. 
Proving  this  is  equivalent  to  proving  the  Gaussian  version  of  the  proof  of  a2  <  ctj 
appearing  in  the  proof  of  Theorem  4  (which  is  the  general  problem). 

Hence,  we  see  that  when  DMA  declares  M2  we  have 

ya  >  Yai  and  ya  <  Ya“ 

This  completes  the  proof  of  Corollary  4. 


Proof  of  Theorem  7 : 

The  objective  is  to  minimize  the  expected  value  of  the  cost  function  which  can  explicitly 
be  written  as 


EWup,  H)} 


-  X  J  p<u„-  v  "•  V  v  ,(V  n> 

U  .  U..H  y 

°  3  V  yv 


-  X  J  p<u8 1  v  »■  v  V  p<v  v  1  «  P(H)  I(v H)  dv% 

VVH  J..,, 

Invoking  the  appropriate  independence  assumptions  (Assumption  2)  yields 

=  X  f  p<u« 1  “  •  y.)  p<“  •  y„ 1 p<y„ 1  H>  p<h>  j< v  «)  dyjy 

..  J  p  a  p  a  o  p  p  ap 

U„.  U  .  H  y  y 

a  P 

Substituting  P(up  =  1 1  ua,  yn)  =  1  -  P(up  =  0  I  ua,  yp)  and  ignoring  the  constant  term 
yields  the  expression  on  the  following  page. 
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= X  f  p(u.r 0 1  v  p<v  y„ 1 «)  p(y« 1  h)  p(H>  t  J<°’  H>  -  jo.  h>  ]  dy  dy 

“  Jpapaa  p  a  p 

VH  ya.yp 

=S  J  P(up=  0 1 V  vX  J  P(V  ya 1  P(yp 1  n> p®  t  J(°*  n> ' Jd«  n)  1  dyadyp 

U  y  H  y 

“  yp  ya 


To  minimize  the  expression  above,  let 


0  if  ’TNNERSUM"  >  0 

P(up  =  0  !  ua,  yp)  =  j 

l  1  otherwise 


where 


"INNERSUM"  >  2  j  P(ua'  ^  1  1  ”>  P(H)  1  ,(0-  H)  -  J(l,  H)  ]  dy 

H  ; 

The  above  expression  can  be  written  as 

=  f  £p(u  I  H)  P(v  I  H)  P(H)  [  J(0,  H)  -  J(l,  H)  ]  ctya 
y  H 

J  a 

Expanding  the  integrand  (which  must  be  negative)  over  H  and  invoking  Assumption  1 
yields 

P(ua  I  H0)  P(y?  I H0)  P(H0)  [  J(l,  H0)  -  J(0,  Hq)  ] 

P(ua  I  Hj)  P(y&  I  Hj)  P(Hj)  [  J(0,  Hj)  -  J(l,  Hj) ) 
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Rearranging  terms  we  get 


p(yR  I  Hq)  ug=o  P(Hj)  P(ua  I  Ht)  [  J(0,  Hj)  -  J(l,  Ht)  ] 

P(yp  I  Hj)  PCH^  P(uq  I f  J(l,  H0)  -  J(0,  HQ)  ] 

where  the  quantity  on  the  right  hand  side  of  the  inequality  is  referred  to  as  when 
ua  =  i  for  i  =  Mj,  M2,  M3, ....  MK. 

This  is  the  optimal  decision  rule  for  DMB  appearing  in  Theorem  7. 


Proof  of  Theorem  8  : 

Once  again,  the  objective  is  to  minimize  the  expected  value  of  the  cost  function  which 
can  explicitly  be  written  as 


E(J(up,  H))=  X  J  P(V  V  V  V  ,(V  H>  dy«dyp 
VVH  y„-yf 

Xf  P(u  I  u  ,  H,  y  ,  y  )  P(u  ,  y  ,  y  I  H)  P(H)  J(u  ,  H)  dy  dy 

J  pet  a  p  a  a  p  p  ap 

u„.  H  v 

a  p  ya.  yp 

Invoking  the  appropriate  independence  assumptions  (Assumption  2)  yields 

-  L  /  P<US  1  V  V  P(V  y«  '  H)  P(yfl 1 P(H>  «Y  H)  dyadyp 

‘.'V*  >.■>, 

=  y  f  P(uR  I  u  ,  y  )  P(un  I  y  )  P(y  i  H)  P(y  I  H)  P(H)  J(u  H)  dy  dy 

J  p  a  p  a  a  a  p  p  ap 

U  .  Uo*  H  V  v 

a  P  ya  yp 
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Explicitly  summing  over  ua  and  integrating  over  yields 

f  P(u  =  M.  I  y  )  V  P(u  lu  =  M.,  H)  P(y  I  H)  P(H)  J(u  H) 
J  a.  1  Ja  Pa1  a  P 

ya  l  VH 

+  P(u  =  M,  I  y  )  y  P(uft  I  u  =  M,,  H)  P(y  I  H)  P(H)  J(ufl ,  H) 
a  *  a  p  a  *  a  P 

VH 

+  P(u  =  M,ly  )  y  P(u  lu  =M3,H)P(y  I H)  P(H)  J(u  , H) 

a  i  a  «  Pa-3  a  p 


+  P(u  =MK  I  y  )  y  P(uR  I  u  =Mk,  H)  P(y  I  H)  P(H)  J(u  H)  dya 
a  ^  a  ““  p  a  a  p 

vH 


Now  set 


p‘  =  y  P(uft  I  u  =  i,  H)  P(y  I H)  P(H)  J(u  ,  H) 
pa  a  p 


To  minimize  the  cost  we  use 


P(u  =  ily)  = 


a  a 


j  M,  M,  M,  Mk 

1  ifP  =min  {  P  ,P  ,P  ,  ...,P  } 

0  otherwise 


Hence,  the  optimal  decision  rule  takes  the  form 


ua  =  Ya(ya)  =  i  if  P(ua  =  i  I  ya)  =  1  fori  =  M1,M2,  M3, ....  Mk 
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Finally,  invoking  Assumption  1,  it  is  a  matter  of  simple,  but  tedious  algebraic 


manipulations  to  put  the  decision  rule  in  the  following  form 


M.  ,  if  A  (y  )  £  a 
1  a  a  1 


ra(ya)  * 


Mj, 

M,,  ifa3SAa(ya)<cx2 


mk-i  1  if  “k-i  ^  \^cj}  < 
•  MK’  Aa^  <0tK-l 


where 

X  J<V  H,)  [  P(u?l  a-  Mr  H.)  -  P(upl  u  =  M,,  H,)  ] 


X  J(u  .  IV  [  P(u  t  V  M,,  H„)  ■  P(a  I  v  Mj,  H0>  ] 

X  «v  Hi>  [  p<v  v  ^  •  Hi»  •  p<>v  v  ^  •  Hi> 1 


X  J(u  .  H„)  [  P(u  I  u  =  M,  .  H„)  -  P(u  I  ua=  Mj  ,  H0)  ] 

X  «V  «,)  l  «»,  1  V  M«'  H>)  ■  P(UB  '  V  M3-  h.>  1 

*■1 - 

X  « V  Ho)  [  P(u#  I  V  M3,  H„)  -  P(us  I V  M4,  H„)  ] 

1> 


(98) 
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X  J(u ...  H.)  [  P(u  I  V  Mk,  H,)  -  P(u  I  ua=  Mk  ,,  H,) ) 

aK4  =  - - - 

X  Xu,,  Hjj)  [ P(u8  I V  Mk_,,  H())  -  P(ue  I  V  Mk,  H0)  ] 

The  decision  rule  appearing  in  (98)  has  been  written  with  all  the  redundant  a's 
removed.  The  redundancies  can  be  proven  in  the  similar  manner  as  was  shown  in  the 
proof  of  Theorem  4  (i.e.,  at  >  c^,  or  more  generally,  in  the  above  case,  aK  l  >  aK). 

The  conditions  for  DMA  declaring  Mlt  M2,  M3, ...,  MK  have  been  derived  in  the 
manner  shown  in  the  proof  of  Theorem  4.  Hence,  the  algebraic  manipulations  have  not 
been  repeated  here. 
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Proof  of  Corollaries  1,2, 5,  6,7  and  8  : 

No  actual  proof  for  the  Gaussian  equations  for  these  corollaries  will  be  presented.  The 
thresholds  for  the  Gaussian  case  are  obtained  by  substituting  the  Gaussian  probability 
density  functions  in  the  threshold  equations  derived  for  the  general  case  and  solving  for  ya 
or  yp.  In  other  words,  the  proof  is  similar  to  that  of  the  three-message  case  (Corollary  3 
and  Corollary  4). 

The  subscripts  of  the  thresholds  indicate  the  decision  maker  whose  decision  they 
characterize  and  the  superscripts  of  the  thresholds  indicate  the  content  of  the  decision.  For 
the  thresholds  of  DMA  we  use  1  (lower),  m  (middle)  and  u  (upper)  depending  on  how 
many  messages  DMA  is  using.  For  the  case  of  K  messages  the  superscripts  are  numbered 
1  through  K-l.  For  the  thresholds  of  DMB  we  use  Mi  through  MK  as  superscripts,  which 
indicates  the  message  of  DMA  that  the  threshold  corresponds  to. 

This  completes  the  discussion  of  Corollaries  1, 2, 5, 6, 7  and  8. 
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Index  of  Notation 


A  brief  explanation  is  presented  for  the  symbols  that  appear  most  frequently  in  the  text. 


y<x>  yp 
Ya,Yp 
u«,  up 

Ya>Yp 

H0,  Hi 
P(H0),  P(Hj) 
PCyJHj),  P(yplHi) 

J(up,  HO 

Mi,  M2,  .... 

N(|i,  o2) 


°a2.  V 


Y  * 

1  a 

Y  I  Y  c 
1  a  *  1  a 

Y  1  Y  m  Y  “ 
1  a  <  1  a  >  1  a 


:  observations  of  DMA  and  DMB  respectively. 

:  the  set  of  observations  for  DMA  and  DMB  respectively. 

:  the  decisions  of  DMA  and  DMB  respectively. 

:  the  decision  rules  of  DMA  and  DMB  respectively. 

:  the  two  possible  hypothesis. 

:  the  a  priori  probabilities  of  Ho  and  Hi  respectively. 

:  known  probability  density  functions  of  the  observations 
of  DMA  and  DMB  conditional  on  Hi  (i  =  0, 1) 

:  the  cost  incurred  by  the  team  choosing  up,  when  Hi  is 
true. 

:  the  K  possible  messages  that  DMA  can  communicate  to 
DMB  (K  =  2,  3, ...). 

:  denotes  a  Gaussian  distribution  with  mean  4  and 
variance  a2. 

:  the  means  under  hypotheses  Ho  and  Hj  respectively. 

:  the  variances  of  the  observations  of  DMA  and  DMB 
respectively. 

:  the  threshold  of  DMA  for  the  two-message  case. 

:  the  thresholds  for  the  isolation  and  centralized  cases. 

:  the  thresholds  of  DMA  for  the  three-message  and 
four-message  cases. 
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v  l  Y  2  Y  K-l 
YpMj,  YpM2, ....  YpMK 

YaML  YpML 

Pr(E) 

ROC 

PF«  pd>  pM 
<J>J(k) 


:  the  thresholds  of  DMA  for  the  general  K  case. 

:  the  thresholds  of  DMB  for  the  two-message, 
three-message,  four-message  and  the  general  K  cases. 

:  the  maximum  likelihood  thresholds  of  DMA  and  DMB 
respectively. 

:  Probability  of  Error. 

:  Receiver  Operating  Characteristic. 

:  Probabilities  of  False  Alarm,  Detection  and  Miss. 

:  the  error  function  for  Decision  Maker  i,  with  j  being  the 
content  of  the  decision  and  k  the  underlying  given 
hypothesis. 
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